-- Logs begin at Thu 2022-09-22 11:49:35 UTC, end at Thu 2022-09-22 12:49:22 UTC. -- Sep 22 12:20:30.589275 dv-cinder-856463-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 12:20:30.598188 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 12:20:30 2022] *** Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: nodename: dv-cinder-856463-4-iscsi Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: machine: x86_64 Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: clock source: unix Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: pcre jit disabled Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: detected number of CPU cores: 4 Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: current working directory: / Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: detected binary path: /usr/bin/uwsgi-core Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: your processes number limit is 47680 Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: your memory page size is 4096 bytes Sep 22 12:20:30.600971 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: detected max file descriptor number: 2048 Sep 22 12:20:30.601724 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: lock engine: pthread robust mutexes Sep 22 12:20:30.601724 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: thunder lock: enabled Sep 22 12:20:30.601724 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 12:20:30.601724 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 12:20:30.640234 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: Python main interpreter initialized at 0x56331e9699c0 Sep 22 12:20:30.640234 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: python threads support enabled Sep 22 12:20:30.640234 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: your server socket listen backlog is limited to 100 connections Sep 22 12:20:30.640234 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: your mercy for graceful operations on workers is 90 seconds Sep 22 12:20:30.640578 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 12:20:30.640658 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: *** Operational MODE: preforking *** Sep 22 12:20:30.640923 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: *** uWSGI is running in multiple interpreter mode *** Sep 22 12:20:30.640923 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: spawned uWSGI master process (pid: 105405) Sep 22 12:20:30.641103 dv-cinder-856463-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 12:20:30.643383 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: spawned uWSGI worker 1 (pid: 105406, cores: 1) Sep 22 12:20:30.643383 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: spawned uWSGI worker 2 (pid: 105407, cores: 1) Sep 22 12:20:30.643383 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 12:20:31.298706 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 12:20:31.300355 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 12:20:32.387942 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:20:32.387942 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: from cryptography.utils import int_from_bytes Sep 22 12:20:32.388699 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:20:32.388699 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: from cryptography.utils import int_from_bytes Sep 22 12:20:32.392810 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:20:32.392810 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: from cryptography.utils import int_from_bytes Sep 22 12:20:32.393228 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:20:32.393228 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: from cryptography.utils import int_from_bytes Sep 22 12:20:34.859703 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:20:34.860543 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:20:34.860658 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:20:34.860658 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:20:34.861069 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:20:34.861069 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:20:34.861200 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:20:34.861273 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:20:34.861345 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:20:34.861592 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.861686 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:20:34.861766 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.861952 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862131 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862290 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862377 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862599 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862709 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.862919 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863025 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863248 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863357 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863558 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863659 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863879 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.863982 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864152 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864356 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864489 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864635 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864787 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.864885 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-4-iscsi {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865101 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865233 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865405 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-4-iscsi {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865745 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.865833 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866057 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866166 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866355 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866495 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866668 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866808 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.866951 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.867088 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.867280 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.867446 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.867613 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.868825 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.869081 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.869327 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.869536 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.869732 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.869939 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.870147 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.870343 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.870555 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.870759 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.870963 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.871181 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.871392 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.871611 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.871816 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.872025 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.872659 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.872761 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.872846 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.872974 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873107 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-4-iscsi {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873239 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873322 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873455 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-4-iscsi {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873549 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873633 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873710 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873839 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.873921 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874242 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874386 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874562 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874654 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874743 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874821 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874903 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.874987 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875068 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875155 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875243 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875325 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875408 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875485 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875620 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875714 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875793 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875868 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.875950 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876026 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876102 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876193 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876270 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876380 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876465 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876549 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876626 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876751 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.876844 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877056 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877147 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877360 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877457 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877612 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877697 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.877917 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878008 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878238 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878331 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878518 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878608 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878766 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.878862 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879079 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879179 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879339 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879424 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879657 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879749 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.879971 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880061 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880271 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880377 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880598 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880684 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880899 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.880992 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881199 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881310 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881522 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881660 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881824 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.881914 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882125 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882208 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882431 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882532 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882745 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.882828 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883048 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883190 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883364 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883461 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883670 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883763 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.883990 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884309 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884419 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884646 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884739 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.884950 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885033 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885251 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885335 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885565 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885650 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885882 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.885970 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886185 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886271 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886487 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886593 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886789 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.886874 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887094 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887187 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887399 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887484 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887705 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887796 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.887953 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888039 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888248 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888390 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888572 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888655 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888886 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.888976 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889185 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889268 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889485 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889648 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889784 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.889876 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890077 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890161 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890379 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890472 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890677 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890760 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.890974 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891056 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891273 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891367 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891573 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891699 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891871 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.891962 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892169 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892268 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892494 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892592 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892795 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.892879 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893093 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893183 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893394 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893487 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893699 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893790 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.893996 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894079 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894308 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894441 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894591 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894678 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894891 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.894985 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895195 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895291 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895493 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895584 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895792 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.895880 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896096 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896179 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896425 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896531 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896725 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.896809 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.897566 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.897657 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.897873 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.897958 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898173 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898257 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898484 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898566 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898778 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.898860 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899078 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899163 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899384 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899471 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899681 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899775 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.899979 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900071 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900277 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900404 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900599 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900701 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900898 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.900994 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901199 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901283 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901497 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901589 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901795 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.901888 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902089 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902184 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902388 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902482 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902686 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902780 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.902992 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903076 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903292 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903430 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903592 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903687 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903900 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.903984 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.904204 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.904317 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.904550 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:20:34.904646 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.904883 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.904982 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905193 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905276 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905521 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905609 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905847 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.905966 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906157 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906241 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906465 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906549 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906776 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.906869 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907098 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907190 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907404 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907495 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907712 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.907805 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908018 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908103 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908348 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908436 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908662 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908777 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.908980 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909064 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909289 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909372 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909600 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909697 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909912 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.909997 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910220 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910305 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910534 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910695 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910847 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.910932 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911163 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911245 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911469 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911562 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911811 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.911896 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.912107 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.912190 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.912475 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913166 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913321 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913408 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913637 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913733 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.913944 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914037 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914250 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914334 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914639 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914736 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914864 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.914956 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915173 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915258 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915481 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915565 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915794 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.915880 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916101 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916198 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916444 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916535 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916754 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.916840 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917060 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917144 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917365 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917459 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917668 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917764 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.917973 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918059 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918281 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918373 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918592 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918677 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918907 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.918996 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919219 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919311 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919526 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919617 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919837 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.919922 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920142 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920239 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920471 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920556 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920777 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.920862 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921083 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921179 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921383 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921468 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921683 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921767 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.921986 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922077 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922284 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922366 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922588 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922671 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922892 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.922977 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923200 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923289 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923525 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923828 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.923913 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924135 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924226 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924475 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924562 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924784 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.924881 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925084 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925169 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925393 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925490 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925699 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.925785 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926000 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926083 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926309 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926404 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926613 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926698 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.926913 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927000 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927231 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927328 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927534 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927619 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927838 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.927922 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929016 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929128 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929210 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929294 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929294 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929437 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929521 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929599 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929674 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929750 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929825 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929907 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.929992 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930070 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930280 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930367 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930607 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930697 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.930919 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931004 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931224 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931309 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931545 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931630 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931862 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.931946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932171 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932265 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932494 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932593 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932801 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.932886 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933102 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933187 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933406 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933569 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933705 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.933821 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934008 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934106 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934298 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934393 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934599 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934691 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934902 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.934998 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935198 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935290 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935499 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935590 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935803 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.935895 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.936105 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.936188 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.936652 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.936977 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937089 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937172 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937268 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937351 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937351 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937491 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937611 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937698 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.937945 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938040 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938249 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938382 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938581 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938679 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938901 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.938994 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939211 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939297 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939524 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939727 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939817 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.939897 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940125 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940212 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940455 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940559 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940764 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.940851 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941072 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941157 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941378 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941481 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941692 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941785 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.941997 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943105 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943105 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943293 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943385 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943544 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943544 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943706 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943794 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943868 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.943940 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944018 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944018 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944660 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944750 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944837 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944837 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.944994 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945069 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945149 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945234 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945324 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945411 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945489 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945670 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945778 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.945972 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947368 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947465 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947546 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947637 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947749 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.947914 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948064 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948224 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948414 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948585 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948747 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.948892 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949051 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949201 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949348 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949496 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949656 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949803 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.949949 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950097 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950204 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950295 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950392 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950472 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950549 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950626 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950704 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950782 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950867 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.950946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951041 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951121 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951198 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951288 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951374 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951460 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951538 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951615 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951750 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.951919 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952059 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952220 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952393 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952551 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952698 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.952861 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953003 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953168 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953313 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953524 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953609 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953828 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.953967 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.954215 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.954519 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.954736 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.954832 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955050 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955183 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955356 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955443 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955662 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955818 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.955974 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956061 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956313 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956403 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956625 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956739 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.956977 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957084 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957261 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957352 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957561 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957654 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957861 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.957946 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958181 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958265 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958485 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958578 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958786 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.958870 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.959086 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.959179 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.959919 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960012 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960266 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960421 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960610 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960755 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.960906 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961004 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961221 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961306 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961537 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961623 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961844 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.961930 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962157 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962242 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962465 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962550 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962769 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.962866 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963089 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963174 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963398 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963492 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963704 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.963789 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964009 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964093 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964339 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964441 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964647 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964740 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.964954 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965041 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965272 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965369 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965579 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965702 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965884 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.965976 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966191 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966288 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966489 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966613 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966796 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.966888 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.967108 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.967203 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.967675 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.967770 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968005 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968096 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968338 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968438 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968661 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.968745 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969002 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969098 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969317 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969411 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969647 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969734 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.969974 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970059 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970281 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970372 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970586 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970673 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970892 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.970979 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971196 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971281 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971500 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971585 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971806 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.971890 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.972385 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.972480 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.972691 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.972779 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.972996 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973082 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973301 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973393 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973602 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973690 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973904 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.973990 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974214 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974331 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974511 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974604 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974821 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.974909 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.975707 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.975818 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976024 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976112 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976353 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976453 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976682 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976778 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.976994 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977092 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977302 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977398 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977601 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977698 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977903 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.977989 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978244 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978331 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978548 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978642 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978881 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.978966 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979209 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979294 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979546 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979632 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979852 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.979946 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980155 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980240 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980502 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980591 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980806 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.980892 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981106 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981204 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981407 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981499 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981714 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.981800 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982017 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982111 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982318 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982404 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982624 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982719 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.982930 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983024 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983236 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983322 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983541 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983635 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983841 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.983936 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984144 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984232 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984466 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984557 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984780 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.984873 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985082 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985167 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985382 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985466 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985680 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985775 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.985989 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986164 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986292 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986378 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986588 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986682 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986894 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.986996 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987276 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987504 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987591 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987805 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.987891 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988106 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988199 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988431 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988519 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988739 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.988833 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989144 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989343 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989428 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989662 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989747 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.989969 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990062 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990268 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990352 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990567 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990652 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990891 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.990985 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991193 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991278 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991491 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991575 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991794 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.991878 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992112 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992196 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992450 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992537 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992754 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.992840 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993060 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993146 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993359 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993444 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993660 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993749 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.993961 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994268 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994352 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994567 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994651 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994864 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.994948 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995160 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995253 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995460 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995551 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995758 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.995842 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996075 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996183 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996402 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996498 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996703 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.996789 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997003 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997109 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997299 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997385 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997637 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997724 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.997940 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998033 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998294 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998380 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998598 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998681 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998907 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.998992 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999227 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999341 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999536 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999641 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999842 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:34.999941 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000149 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000237 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000471 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000577 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000783 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.000878 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001088 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001174 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001396 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001483 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001693 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001780 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.001992 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002077 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002313 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002398 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002621 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002715 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.002926 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003011 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003244 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003338 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003559 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003645 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003877 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.003964 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004179 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004274 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004510 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004601 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004817 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.004903 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005119 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005214 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005498 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005591 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005727 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.005813 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006034 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006144 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006364 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006451 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006671 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006766 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.006982 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007091 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007285 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007370 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007586 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007674 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007890 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.007977 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008192 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008278 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008519 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008605 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008840 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.008934 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009144 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009229 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009442 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009534 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009747 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.009836 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010047 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010139 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010350 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010448 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010649 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.010735 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011073 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011161 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011382 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011476 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011686 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011778 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.011987 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012074 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012341 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012443 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012617 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012711 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.012927 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013014 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013237 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013331 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013539 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013631 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.013949 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014043 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014256 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014350 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014561 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014654 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014868 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.014972 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015169 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015257 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015469 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015561 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015773 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.015858 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016094 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016181 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016417 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016526 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016716 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.016802 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017013 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017148 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017333 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017419 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017632 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017725 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.017949 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018043 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018361 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018447 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018665 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018766 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.018966 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019051 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019373 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019459 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019681 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019782 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.019988 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020096 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020332 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020424 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020643 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020728 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.020963 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.021061 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.021266 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.021361 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.021577 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.021669 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.022405 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.022507 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.022726 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.022813 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023047 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023139 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023352 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023438 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023661 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023754 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.023964 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024049 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024285 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024417 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024623 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024711 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.024931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025025 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025248 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025335 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025654 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025739 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.025973 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026059 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026277 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026366 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026596 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026697 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.026913 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027014 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027216 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027302 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027516 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027601 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027822 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.027926 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028119 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028206 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028444 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028536 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028764 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.028872 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029067 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029161 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029374 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029459 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029674 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029772 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.029978 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030063 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030273 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030357 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030572 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030659 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030889 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.030974 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031187 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031272 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031505 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031598 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031810 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.031895 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032127 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032212 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032463 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032551 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032770 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.032871 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033087 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033172 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033392 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033479 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033689 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033775 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.033989 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034083 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034284 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034369 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034622 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034707 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.034920 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035014 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035236 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035329 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035559 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035653 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035885 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.035982 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036192 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036286 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036562 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036705 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036867 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.036967 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.037187 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.037274 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.037534 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038129 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038350 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038455 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038671 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038757 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.038972 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039057 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039272 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039360 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039580 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039703 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039879 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.039966 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040187 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040274 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040510 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040597 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040816 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.040901 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041115 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041202 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041411 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041497 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041710 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.041809 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042028 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042115 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042331 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042418 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042648 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042742 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.042954 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043041 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043251 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043336 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043552 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043654 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043850 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.043944 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044187 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044272 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044510 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044610 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044835 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.044929 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045141 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045239 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045462 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045550 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045774 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.045867 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046085 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046169 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046397 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046523 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046704 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.046791 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047015 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047101 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047326 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047412 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047635 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047731 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.047940 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048026 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048251 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048373 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048584 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048672 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048896 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.048992 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.049406 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.049500 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.049733 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.049820 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050042 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050140 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050353 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050447 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050663 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050756 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.050971 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051071 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051278 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051364 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051584 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051681 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051890 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.051977 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052194 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052286 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052526 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052613 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052853 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.052941 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053192 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053277 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053516 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053602 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053851 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.053939 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054166 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054251 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054569 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054787 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.054873 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055099 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055183 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055445 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055540 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055755 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.055849 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056058 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056153 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056389 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056480 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056702 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.056809 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057012 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057110 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057319 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057406 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057624 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057709 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.057933 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058019 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058241 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058334 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058546 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058643 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058850 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.058947 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059159 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059248 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059467 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059554 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059783 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.059882 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060114 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060209 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060452 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060551 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060763 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.060904 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061070 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061163 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061381 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061466 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061890 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.061976 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062200 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062287 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062529 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062614 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062852 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.062938 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063170 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063265 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063481 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063576 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063792 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.063878 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064114 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064218 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064441 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064529 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064744 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.064830 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065047 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065131 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065350 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065444 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065649 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065776 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.065964 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066056 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066270 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066364 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066567 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066659 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.066882 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.067050 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.067186 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.067282 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.067709 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.067795 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.068054 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.068140 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.068395 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.068544 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069249 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069348 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069582 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069675 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069899 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.069987 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070205 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070292 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070527 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070621 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070833 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.070920 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071136 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071224 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071448 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071541 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071755 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.071843 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072057 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072142 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072385 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072473 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072696 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.072783 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073002 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073089 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073305 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073399 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073609 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073694 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073909 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.073994 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074230 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074325 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074532 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074625 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074835 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.074920 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075136 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075230 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075440 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075532 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075741 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.075826 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076140 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076376 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076467 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076684 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076770 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.076996 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077158 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077299 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077385 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077603 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077688 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.077933 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078020 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078196 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078283 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078544 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078629 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078846 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.078932 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079147 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079232 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079464 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079550 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079765 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.079859 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080065 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080157 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080403 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080506 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080713 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.080799 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081033 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081121 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081343 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081438 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081649 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081735 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.081990 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.082075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.082302 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.082400 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.082829 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.082916 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083161 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083246 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083480 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083574 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083812 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.083904 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.084137 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.084230 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085012 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085118 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085319 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085412 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085624 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085771 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086105 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086261 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086417 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086575 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086730 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.086887 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087040 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087197 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087347 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087506 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087654 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087817 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.087953 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088128 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088255 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088462 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088587 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088772 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.088893 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089083 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089200 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089394 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089495 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089702 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.089790 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090012 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090100 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090321 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090409 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090635 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090729 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.090979 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091073 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091299 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091385 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091614 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091701 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.091925 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092018 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092238 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092342 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092567 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092662 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092874 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.092960 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093180 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093273 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093488 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093573 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093801 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.093895 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094126 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094221 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094433 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094526 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094735 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.094833 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.095396 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.095482 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.095710 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.095802 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096027 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096122 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096370 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096459 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096681 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.096769 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.097001 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.097350 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.097573 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.097660 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.097881 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098007 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098199 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098294 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098506 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098593 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098834 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.098919 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099170 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099256 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099494 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099581 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099819 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.099914 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100148 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100234 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100476 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100565 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100781 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.100884 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101091 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101177 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101404 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101487 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101712 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.101810 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102012 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102097 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102313 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102406 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102616 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102702 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.102917 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103002 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103216 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103300 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103522 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103615 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103820 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.103912 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104125 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104213 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104447 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104537 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104750 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.104835 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105047 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105133 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105345 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105432 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105754 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.105942 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106036 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106248 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106341 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106547 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106639 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.106941 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107145 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107230 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107445 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107537 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107742 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.107901 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108072 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108158 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108422 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108512 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108735 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.108831 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109201 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109363 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109459 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109681 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109812 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.109986 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110074 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110305 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110389 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110619 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110705 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.110932 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111018 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111239 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111323 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111566 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111653 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111871 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.111957 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112178 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112263 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112509 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112597 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112816 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.112902 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113121 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113215 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113430 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113524 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113751 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.113838 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114072 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114167 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114376 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114461 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114695 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.114781 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115007 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115105 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115321 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115407 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115658 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115749 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.115966 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116061 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116334 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116461 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116619 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116706 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.116926 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117019 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117231 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117317 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117541 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117627 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117847 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.117933 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118160 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118245 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118464 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118557 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118771 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.118864 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119083 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119178 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119394 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119489 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119717 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.119803 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120038 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120122 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120368 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120469 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120691 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.120784 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121017 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121104 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121360 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121447 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121670 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.121755 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122008 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122095 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122334 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122422 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122644 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122737 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.122953 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.123038 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.123259 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.123352 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:20:35.123500 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:20:35.123586 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:20:35.277099 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO dbcounter [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Registered counter for database nova_api Sep 22 12:20:35.277312 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO dbcounter [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Registered counter for database nova_api Sep 22 12:20:35.298619 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_db.sqlalchemy.engines [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.300466 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.305281 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writer thread running {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.306941 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writer thread running {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.362394 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.context [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42be6b44-0984-4460-8191-0bf6d60d534a(cell1) {{(pid=105407) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 12:20:35.363379 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.context [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42be6b44-0984-4460-8191-0bf6d60d534a(cell1) {{(pid=105406) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 12:20:35.366214 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:20:35.366694 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:20:35.367252 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:20:35.367722 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:20:35.368245 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:20:35.369004 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:20:35.369289 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:20:35.369453 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:20:35.370007 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:20:35.370446 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:20:35.371432 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:20:35.372426 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_concurrency.lockutils [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:20:35.373434 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO dbcounter [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Registered counter for database nova_cell0 Sep 22 12:20:35.374383 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO dbcounter [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Registered counter for database nova_cell0 Sep 22 12:20:35.377443 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO dbcounter [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Registered counter for database nova_cell1 Sep 22 12:20:35.378438 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO dbcounter [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Registered counter for database nova_cell1 Sep 22 12:20:35.385723 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_db.sqlalchemy.engines [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.387377 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_db.sqlalchemy.engines [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.389487 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.392858 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.394687 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writer thread running {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.395027 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writer thread running {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.396458 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writer thread running {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.535991 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writer thread running {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.542307 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO dbcounter [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Registered counter for database nova_cell0 Sep 22 12:20:35.545930 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO dbcounter [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Registered counter for database nova_cell0 Sep 22 12:20:35.551182 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_db.sqlalchemy.engines [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.555296 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG oslo_db.sqlalchemy.engines [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:20:35.556453 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writer thread running {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.560023 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writer thread running {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:20:35.892468 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: WARNING keystonemiddleware.auth_token [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:20:35.894856 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: WARNING keystonemiddleware.auth_token [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:20:35.900756 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: WARNING keystonemiddleware.auth_token [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:20:35.902650 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: WARNING keystonemiddleware.auth_token [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:20:36.237146 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: WARNING keystonemiddleware.auth_token [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:20:36.242803 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: WARNING keystonemiddleware.auth_token [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:20:36.243581 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: WARNING keystonemiddleware.auth_token [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:20:36.248734 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: WARNING keystonemiddleware.auth_token [None req-ab5351fa-456b-4a60-bfe8-06bfee828579 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:20:36.248872 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56331e9699c0 pid: 105407 (default app) Sep 22 12:20:36.250891 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:20:36.252059 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001704 Sep 22 12:20:36.252746 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Sep 22 12:20:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:20:36.253985 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56331e9699c0 pid: 105406 (default app) Sep 22 12:21:57.394159 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:21:57.395209 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 22 12:21:57.396394 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:21:57.407598 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_api:SELECT=3 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:57.408727 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_cell0:SELECT=3 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:57.409453 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_cell1:SELECT=3 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:57.411941 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:21:58.287628 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-267e2df2-0d62-47c7-b36e-4f2f3c5f49b8 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:21:58.319858 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-267e2df2-0d62-47c7-b36e-4f2f3c5f49b8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917414 Sep 22 12:21:58.324340 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 22 12:21:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:00.951703 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:00.952574 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-5c954686-56a1-4271-b4c8-e61d96fe2a07 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 22 12:22:00.953146 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:01.386704 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-8f105cbb-dba0-4b95-94f9-ad8fb9542bfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:01.433612 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-8f105cbb-dba0-4b95-94f9-ad8fb9542bfa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.473030 Sep 22 12:22:01.433833 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:01.448337 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_api:SELECT=3 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:01.449059 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_cell0:SELECT=3 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:01.450949 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_cell1:SELECT=3 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:01.451684 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:01.659592 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-da015b03-e4ed-48e7-8c98-ae873a68b40a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:01.729356 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-da015b03-e4ed-48e7-8c98-ae873a68b40a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286330 Sep 22 12:22:01.729941 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 22 12:22:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:04.356257 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-8f105cbb-dba0-4b95-94f9-ad8fb9542bfa admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:04.358033 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-8f105cbb-dba0-4b95-94f9-ad8fb9542bfa admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Sep 22 12:22:04.358640 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:05.124199 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-1ee6e36f-8b7d-4403-9213-6bf23dba0b66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "ds512M", "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:05.165264 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-1ee6e36f-8b7d-4403-9213-6bf23dba0b66 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.800456 Sep 22 12:22:05.165832 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:05.178489 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-da5b9135-b1e0-4e46-a2c3-4a12826f3fb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:05.220953 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-da5b9135-b1e0-4e46-a2c3-4a12826f3fb9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046283 Sep 22 12:22:05.222434 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 22 12:22:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:07.815493 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-1ee6e36f-8b7d-4403-9213-6bf23dba0b66 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:07.816643 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-1ee6e36f-8b7d-4403-9213-6bf23dba0b66 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 22 12:22:07.817064 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:08.234470 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c429fdc6-97f9-4601-bb27-fb7ea89fa205 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "id": "d2"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:08.255202 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-c429fdc6-97f9-4601-bb27-fb7ea89fa205 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431438 Sep 22 12:22:08.255778 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:08.267905 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-cc0b0da5-f113-4b6b-bafc-8305a1c28ed6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:08.295913 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-cc0b0da5-f113-4b6b-bafc-8305a1c28ed6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031725 Sep 22 12:22:08.296525 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 22 12:22:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:10.904389 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c429fdc6-97f9-4601-bb27-fb7ea89fa205 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:10.905413 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-c429fdc6-97f9-4601-bb27-fb7ea89fa205 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 22 12:22:10.905986 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:11.313768 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-602081d5-3d72-47d6-9430-731c2de5d7b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "d3"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:11.334083 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-602081d5-3d72-47d6-9430-731c2de5d7b1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.421620 Sep 22 12:22:11.336347 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:11.347839 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-b1db8748-664c-41ee-84fd-8587fe4923f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:11.375732 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-b1db8748-664c-41ee-84fd-8587fe4923f8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032538 Sep 22 12:22:11.376538 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 22 12:22:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:14.124848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-602081d5-3d72-47d6-9430-731c2de5d7b1 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:14.125924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-602081d5-3d72-47d6-9430-731c2de5d7b1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Sep 22 12:22:14.126346 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:14.553979 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "disk": 20, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:14.575399 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442293 Sep 22 12:22:14.575990 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:14.591461 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-947abd4f-8b40-4d9e-9ba7-e2dbb2d39c00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:14.620036 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-947abd4f-8b40-4d9e-9ba7-e2dbb2d39c00 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033287 Sep 22 12:22:14.620662 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1336 bytes} [Thu Sep 22 12:22:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:22:17.230048 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:17.231074 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 22 12:22:17.231495 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:17.648106 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-0e03af46-38e1-4d38-84f7-af01f9756d2b admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:17.674996 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-0e03af46-38e1-4d38-84f7-af01f9756d2b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.437176 Sep 22 12:22:17.675994 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 22 12:22:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:20.391387 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:20.392458 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-f08d4692-90e3-4962-85c9-ebfa8f5c0d76 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 22 12:22:20.392876 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:20.781689 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-78eed1b4-b33e-4458-acd9-ea50fea38f1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "swap": 0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:20.801432 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-78eed1b4-b33e-4458-acd9-ea50fea38f1d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.402124 Sep 22 12:22:20.802004 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:20.824006 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-50c37fa3-8ab4-4b61-ab56-3c2e85364372 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:20.855744 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-50c37fa3-8ab4-4b61-ab56-3c2e85364372 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035827 Sep 22 12:22:20.856598 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 22 12:22:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:22:23.478023 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-78eed1b4-b33e-4458-acd9-ea50fea38f1d admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:23.479039 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-78eed1b4-b33e-4458-acd9-ea50fea38f1d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 22 12:22:23.479444 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:23.865480 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-8334c1da-63d7-4d34-8562-c01e443759da admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:23.888604 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-8334c1da-63d7-4d34-8562-c01e443759da admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402326 Sep 22 12:22:23.896478 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:23.901481 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-5422aece-6518-40e3-8f5a-49f8d328b54a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:23.927291 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-5422aece-6518-40e3-8f5a-49f8d328b54a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029559 Sep 22 12:22:23.927876 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 22 12:22:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:26.554425 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-8334c1da-63d7-4d34-8562-c01e443759da admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:26.555375 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-8334c1da-63d7-4d34-8562-c01e443759da admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 22 12:22:26.555787 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:26.980087 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-a4691229-285d-4be4-9c23-f44bd0d23ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:27.005370 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-a4691229-285d-4be4-9c23-f44bd0d23ef3 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.441895 Sep 22 12:22:27.014352 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:27.020912 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-342e1268-2c6b-4367-bfa6-e4d02b400611 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:27.051124 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-342e1268-2c6b-4367-bfa6-e4d02b400611 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035356 Sep 22 12:22:27.052348 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 22 12:22:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:22:29.652270 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-a4691229-285d-4be4-9c23-f44bd0d23ef3 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:29.653313 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-a4691229-285d-4be4-9c23-f44bd0d23ef3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 22 12:22:29.653904 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:30.098776 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-bc8765e7-4710-4699-89b5-a882b9218820 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:30.106791 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:30.123063 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-bc8765e7-4710-4699-89b5-a882b9218820 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462767 Sep 22 12:22:30.123616 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:30.135563 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-aac93c87-5740-4d6f-86cc-8f9019b6b157 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:30.162107 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-aac93c87-5740-4d6f-86cc-8f9019b6b157 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030133 Sep 22 12:22:30.162686 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 22 12:22:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:22:32.775903 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-bc8765e7-4710-4699-89b5-a882b9218820 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:32.776960 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-bc8765e7-4710-4699-89b5-a882b9218820 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 22 12:22:32.780715 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:33.226138 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "swap": 0}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:33.232774 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:33.250426 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467053 Sep 22 12:22:33.251240 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1283 bytes} [Thu Sep 22 12:22:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:33.263617 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-cc9a422e-58d0-467e-936b-5d21f9c93175 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:33.291694 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-cc9a422e-58d0-467e-936b-5d21f9c93175 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032200 Sep 22 12:22:33.300957 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1333 bytes} [Thu Sep 22 12:22:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:22:51.086843 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:51.087901 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 22 12:22:51.088342 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:22:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:51.099133 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:22:51.465600 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c16b7654-70e7-4bd4-bd58-2ec43da036ae admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:51.483607 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-c16b7654-70e7-4bd4-bd58-2ec43da036ae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.389199 Sep 22 12:22:51.484138 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 22 12:22:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:52.773244 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:52.774288 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-2d441d13-3182-4dca-bedc-e2e90f33e6e2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 22 12:22:52.774686 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:22:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:53.296382 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c75b28e0-4494-4036-9d1b-9a6e13b12397 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:53.302157 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.wsgi [None req-c75b28e0-4494-4036-9d1b-9a6e13b12397 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c75b28e0-4494-4036-9d1b-9a6e13b12397 admin admin] Request method failure captured: Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept: application/json Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept-Encoding: gzip, deflate Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Connection: keep-alive Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Content-Length: 0 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Host: 10.222.0.33 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-System-Scope: None Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: User-Agent: python-novaclient Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Auth-Token: gAAAAABjLFOcjUP8QqJiUD4uVun0wlyDifiL2uNRw4qfrD40oELeXYDAUUDO3lBZ-RM_oSb--rth0d_rbf1PzWx4YkkLawOomVMdXQDa4_wZQSOF1poLXgBi1uyPgyCaB_zdw42W3DIcvRZn29z33tWQSF4ig2s_QcmyiCcD9fRQNrSVOZmYKtM Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Id: None Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Name: None Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Identity-Status: Confirmed Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Is-Admin-Project: True Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Id: default Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Name: Default Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Name: admin Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Role: admin,reader,member Sep 22 12:22:53.305384 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Roles: admin,reader,member Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant: admin Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Name: admin Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User: admin Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Id: default Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Name: Default Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Name: admin Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: method: > Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: exception: Flavor 42 could not be found. Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: action_args: {'id': '42'} Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:53.307075 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:53.308115 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-c75b28e0-4494-4036-9d1b-9a6e13b12397 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:53.310762 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-c75b28e0-4494-4036-9d1b-9a6e13b12397 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389063 Sep 22 12:22:53.310762 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 22 12:22:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:53.317043 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-38440b72-9727-466f-b685-6c57424b6261 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:53.339267 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-38440b72-9727-466f-b685-6c57424b6261 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026214 Sep 22 12:22:53.339805 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:53.351194 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-55a6b4b0-b27b-4899-a365-545a0b7842e1 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:53.373123 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-55a6b4b0-b27b-4899-a365-545a0b7842e1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027081 Sep 22 12:22:53.373697 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:53.384122 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-18f2199b-ee1a-42fa-a5bc-cd62e6652bb3 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:53.389855 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.wsgi [None req-18f2199b-ee1a-42fa-a5bc-cd62e6652bb3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-18f2199b-ee1a-42fa-a5bc-cd62e6652bb3 admin admin] Request method failure captured: Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept: application/json Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept-Encoding: gzip, deflate Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Connection: keep-alive Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Content-Length: 0 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Host: 10.222.0.33 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-System-Scope: None Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: User-Agent: python-novaclient Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Auth-Token: gAAAAABjLFOcjUP8QqJiUD4uVun0wlyDifiL2uNRw4qfrD40oELeXYDAUUDO3lBZ-RM_oSb--rth0d_rbf1PzWx4YkkLawOomVMdXQDa4_wZQSOF1poLXgBi1uyPgyCaB_zdw42W3DIcvRZn29z33tWQSF4ig2s_QcmyiCcD9fRQNrSVOZmYKtM Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Id: None Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Name: None Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Identity-Status: Confirmed Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Is-Admin-Project: True Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Id: default Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Name: Default Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Name: admin Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Role: admin,reader,member Sep 22 12:22:53.393123 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Roles: admin,reader,member Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant: admin Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Name: admin Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User: admin Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Id: default Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Name: Default Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Name: admin Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: method: > Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: exception: Flavor 42 could not be found. Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: action_args: {'id': '42'} Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:53.394646 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:53.395652 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:53.397045 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-18f2199b-ee1a-42fa-a5bc-cd62e6652bb3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:53.398267 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-18f2199b-ee1a-42fa-a5bc-cd62e6652bb3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014018 Sep 22 12:22:53.398267 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 22 12:22:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:54.622639 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-55a6b4b0-b27b-4899-a365-545a0b7842e1 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:54.623651 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-55a6b4b0-b27b-4899-a365-545a0b7842e1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 22 12:22:54.624049 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:55.137761 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-24f55f84-1bac-411e-bef3-a2adcb00f50e admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:55.142852 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.wsgi [None req-24f55f84-1bac-411e-bef3-a2adcb00f50e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-24f55f84-1bac-411e-bef3-a2adcb00f50e admin admin] Request method failure captured: Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept: application/json Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept-Encoding: gzip, deflate Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Connection: keep-alive Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Content-Length: 0 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Host: 10.222.0.33 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-System-Scope: None Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: User-Agent: python-novaclient Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Auth-Token: gAAAAABjLFOePAELJyYHGavxS-vn_rNRTy65aqoBFkNqjxOwgeVijXJycsWQRxkQ65Og8C_krIc70IBaNFVnNq3KM_IZejxDzeBbY9WzMPh37DYjh82w_06SxIFQo1mGzhhN-waXYSSM7mt7MtvTnl-itS6JVbgsgO6fQV9QCjpwenQTde01gP8 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Id: None Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Name: None Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Identity-Status: Confirmed Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Is-Admin-Project: True Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Id: default Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Name: Default Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Name: admin Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Role: admin,reader,member Sep 22 12:22:55.144924 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Roles: admin,reader,member Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant: admin Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Name: admin Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User: admin Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Id: default Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Name: Default Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Name: admin Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: method: > Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: exception: Flavor 84 could not be found. Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: action_args: {'id': '84'} Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:55.146246 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:55.147053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.148416 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-24f55f84-1bac-411e-bef3-a2adcb00f50e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:55.149498 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-24f55f84-1bac-411e-bef3-a2adcb00f50e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385620 Sep 22 12:22:55.149498 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 22 12:22:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:55.156522 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-8e2f18d9-a169-4f57-9b87-dc2fc2b46cec admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:55.171654 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-8e2f18d9-a169-4f57-9b87-dc2fc2b46cec admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019021 Sep 22 12:22:55.172170 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:55.181505 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-9331a4e1-84c7-4759-bb02-c35769c7a6fa admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:55.196574 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-9331a4e1-84c7-4759-bb02-c35769c7a6fa admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018559 Sep 22 12:22:55.197089 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:55.206623 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d5c42a35-47ff-4921-afa3-5935d31ed7af admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:55.211415 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.wsgi [None req-d5c42a35-47ff-4921-afa3-5935d31ed7af admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d5c42a35-47ff-4921-afa3-5935d31ed7af admin admin] Request method failure captured: Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept: application/json Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept-Encoding: gzip, deflate Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Connection: keep-alive Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Content-Length: 0 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Host: 10.222.0.33 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-System-Scope: None Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: User-Agent: python-novaclient Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Auth-Token: gAAAAABjLFOePAELJyYHGavxS-vn_rNRTy65aqoBFkNqjxOwgeVijXJycsWQRxkQ65Og8C_krIc70IBaNFVnNq3KM_IZejxDzeBbY9WzMPh37DYjh82w_06SxIFQo1mGzhhN-waXYSSM7mt7MtvTnl-itS6JVbgsgO6fQV9QCjpwenQTde01gP8 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Id: None Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Name: None Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Identity-Status: Confirmed Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Is-Admin-Project: True Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Id: default Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Name: Default Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Name: admin Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Role: admin,reader,member Sep 22 12:22:55.212946 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Roles: admin,reader,member Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant: admin Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Name: admin Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User: admin Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Id: default Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Name: Default Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Name: admin Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: method: > Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: exception: Flavor 84 could not be found. Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: action_args: {'id': '84'} Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:55.214501 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:55.215507 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:55.216915 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d5c42a35-47ff-4921-afa3-5935d31ed7af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:55.218141 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-d5c42a35-47ff-4921-afa3-5935d31ed7af admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011627 Sep 22 12:22:55.218141 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Sep 22 12:22:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:56.420818 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-9331a4e1-84c7-4759-bb02-c35769c7a6fa admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:56.421824 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-9331a4e1-84c7-4759-bb02-c35769c7a6fa admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 22 12:22:56.422220 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:56.935179 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d8100c63-a372-4c9e-b24b-e31404639cae admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:56.941167 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.wsgi [None req-d8100c63-a372-4c9e-b24b-e31404639cae admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d8100c63-a372-4c9e-b24b-e31404639cae admin admin] Request method failure captured: Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept: application/json Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Accept-Encoding: gzip, deflate Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Connection: keep-alive Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Content-Length: 0 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Host: 10.222.0.33 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Openstack-System-Scope: None Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: User-Agent: python-novaclient Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Auth-Token: gAAAAABjLFOgaIJzUBQ-DPhOhw4-syrnS6vRpS37BXg6yv7tOtlZ6yzEw_I7YszKxRh0PdpFPlOu2i5QYsyf1jl4U8r2rmfKer4-xDi5YdHry5eO1DQWnANeNzGycguKZzjF4yn2QIXG9kkN_Aa4g7G6IDIe27WsSbATtZcq7L3FdEhRJSkGGuQ Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Id: None Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Domain-Name: None Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Identity-Status: Confirmed Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Is-Admin-Project: True Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Id: default Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Domain-Name: Default Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Project-Name: admin Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Role: admin,reader,member Sep 22 12:22:56.942666 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Roles: admin,reader,member Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant: admin Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-Tenant-Name: admin Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User: admin Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Id: default Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Domain-Name: Default Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: X-User-Name: admin Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: method: > Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: exception: Flavor 451 could not be found. Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: action_args: {'id': '451'} Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:56.944094 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:56.944931 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: ERROR nova.api.openstack.wsgi Sep 22 12:22:56.946191 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-d8100c63-a372-4c9e-b24b-e31404639cae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:56.947421 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-d8100c63-a372-4c9e-b24b-e31404639cae admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385744 Sep 22 12:22:56.947421 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:22:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:56.953886 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-b93d932c-0933-4638-9b10-ee5dbf5e1f16 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:56.968935 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-b93d932c-0933-4638-9b10-ee5dbf5e1f16 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018584 Sep 22 12:22:56.969469 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:56.979579 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:56.995712 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019544 Sep 22 12:22:56.996547 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Sep 22 12:22:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:22:57.006080 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-b6bfb94e-0375-4209-a266-83ef1e92e456 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:57.011259 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.wsgi [None req-b6bfb94e-0375-4209-a266-83ef1e92e456 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-b6bfb94e-0375-4209-a266-83ef1e92e456 admin admin] Request method failure captured: Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept: application/json Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Accept-Encoding: gzip, deflate Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Connection: keep-alive Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Content-Length: 0 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Host: 10.222.0.33 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-Api-Version: compute 2.92 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Openstack-System-Scope: None Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: User-Agent: python-novaclient Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Auth-Token: gAAAAABjLFOgaIJzUBQ-DPhOhw4-syrnS6vRpS37BXg6yv7tOtlZ6yzEw_I7YszKxRh0PdpFPlOu2i5QYsyf1jl4U8r2rmfKer4-xDi5YdHry5eO1DQWnANeNzGycguKZzjF4yn2QIXG9kkN_Aa4g7G6IDIe27WsSbATtZcq7L3FdEhRJSkGGuQ Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Id: None Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Domain-Name: None Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Identity-Status: Confirmed Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Is-Admin-Project: True Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Openstack-Nova-Api-Version: 2.92 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Id: default Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Domain-Name: Default Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Project-Name: admin Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Role: admin,reader,member Sep 22 12:22:57.012797 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Roles: admin,reader,member Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8012745f80ac4412b0055fc9da17a750"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8012745f80ac4412b0055fc9da17a750"}]}] Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant: admin Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Id: 8012745f80ac4412b0055fc9da17a750 Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-Tenant-Name: admin Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User: admin Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Id: default Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Domain-Name: Default Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Id: 9dcd38c10c5f47bf8d47fab51d035bf9 Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: X-User-Name: admin Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: method: > Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: exception: Flavor 451 could not be found. Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: action_args: {'id': '451'} Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:22:57.014508 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:57.015477 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: ERROR nova.api.openstack.wsgi Sep 22 12:22:57.016848 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-b6bfb94e-0375-4209-a266-83ef1e92e456 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:22:57.018098 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-b6bfb94e-0375-4209-a266-83ef1e92e456 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011704 Sep 22 12:22:57.018098 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:22:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 22 12:22:58.219319 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:58.220359 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 22 12:22:58.220760 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:22:58.736995 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-171f8f4e-9307-452d-8f8d-184dce7a4c00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:22:58.755615 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-171f8f4e-9307-452d-8f8d-184dce7a4c00 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.397466 Sep 22 12:22:58.756154 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 22 12:22:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:22:59.974603 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:22:59.975605 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 22 12:22:59.975998 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:23:00.487929 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-5f7a253b-7130-4394-aca9-2a5d95ccceba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:23:00.507081 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-5f7a253b-7130-4394-aca9-2a5d95ccceba admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.394092 Sep 22 12:23:00.507624 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 22 12:23:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:23:01.718759 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:23:01.719773 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 22 12:23:01.720173 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:23:02.236214 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-da55884e-a09f-492c-b7ef-50d112e112d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:23:02.255899 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-da55884e-a09f-492c-b7ef-50d112e112d8 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.395911 Sep 22 12:23:02.256473 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 22 12:23:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:23:03.462152 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:23:03.463159 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 22 12:23:03.463556 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:23:03.977265 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-431cc3dd-36e2-4f33-b99f-9033ffb8d4d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:23:03.995050 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-431cc3dd-36e2-4f33-b99f-9033ffb8d4d0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396136 Sep 22 12:23:03.995597 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Sep 22 12:23:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:23:05.194968 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:23:05.195980 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 22 12:23:05.197166 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:23:05.713871 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-0c10bd6a-3b79-4bfd-858f-b2ca1b933c1a admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:23:05.734649 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-0c10bd6a-3b79-4bfd-858f-b2ca1b933c1a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.399396 Sep 22 12:23:05.735115 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Sep 22 12:23:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:24:01.983624 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:01.984707 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-1c0aee70-af27-4037-ac7f-891c22ec0ec2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 22 12:24:01.985107 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 931 bytes} [Thu Sep 22 12:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:24:01.996381 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:02.378629 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-58a52618-b625-418d-8917-b1b07bfbefc4 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:02.399051 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-58a52618-b625-418d-8917-b1b07bfbefc4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407262 Sep 22 12:24:02.399584 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1292 bytes} [Thu Sep 22 12:24:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:24:02.421110 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_api:SELECT=14 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:24:02.424951 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-b858ab51-0105-46ee-bc8c-6a34cc13ecd2 admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:02.432225 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-b858ab51-0105-46ee-bc8c-6a34cc13ecd2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012695 Sep 22 12:24:02.432770 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Sep 22 12:24:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:24:02.444066 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-c35653e2-6241-4946-a64c-b6ed23395007 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:02.451268 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-c35653e2-6241-4946-a64c-b6ed23395007 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010768 Sep 22 12:24:02.451776 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Sep 22 12:24:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:24:02.463189 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:02.470068 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010267 Sep 22 12:24:02.470567 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1286 bytes} [Thu Sep 22 12:24:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:24:02.482342 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-b6bceada-89aa-444e-b954-eb119ec20961 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:24:02.489320 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-b6bceada-89aa-444e-b954-eb119ec20961 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010426 Sep 22 12:24:02.489831 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1283 bytes} [Thu Sep 22 12:24:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:27:01.888677 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:01.889725 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 22 12:27:01.890118 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:27:02.029268 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_api:SELECT=6 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:02.184948 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:02.189891 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:02.190365 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:02.190791 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:02.191496 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:02.191938 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:02.192389 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:02.223889 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-9d924e43-2b8f-4ffa-9906-bb93163ffccb admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.195926 Sep 22 12:27:02.224957 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:27:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:27:03.308548 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:03.309616 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 22 12:27:03.310012 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:27:03.503074 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:03.506614 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:03.507089 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:03.507515 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:03.508220 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:03.508694 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:03.509109 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:03.528502 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-82866227-ac83-4a04-b5e8-faef5771a2f3 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078697 Sep 22 12:27:03.528999 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:27:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:27:15.049604 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:15.050601 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 22 12:27:15.051019 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:27:15.196956 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_cell0:SELECT=4 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:15.197593 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_cell1:SELECT=4 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:15.198200 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG dbcounter [-] [105407] Writing DB stats nova_api:SELECT=8 {{(pid=105407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:27:15.246535 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:15.249964 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:15.250441 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:15.250869 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:15.251606 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:15.252053 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:15.252504 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:15.277363 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-744ff861-3548-4322-9d65-b8479dfe1955 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085023 Sep 22 12:27:15.277903 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:27:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:27:16.356006 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG nova.api.openstack.wsgi [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] Calling method '>' {{(pid=105406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:16.357073 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: INFO nova.api.openstack.requestlog [None req-2c0c1105-09d2-4b73-b496-d16623866c5c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 22 12:27:16.357467 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: [pid: 105406|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Sep 22 12:27:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:27:16.547604 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG nova.api.openstack.wsgi [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Calling method '>' {{(pid=105407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:27:16.551052 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:16.551524 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:16.551947 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:16.552683 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:27:16.553124 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:27:16.553536 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: DEBUG oslo_concurrency.lockutils [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:27:16.574614 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: INFO nova.api.openstack.requestlog [None req-a8cf213d-ade6-42b4-8283-6c2306e05f3f admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078731 Sep 22 12:27:16.575155 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: [pid: 105407|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Sep 22 12:27:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:28:14.504016 dv-cinder-856463-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 22 12:28:14.505376 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: Thu Sep 22 12:28:14 2022 - graceful shutdown triggered... Sep 22 12:28:14.505857 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: Gracefully killing worker 1 (pid: 105406)... Sep 22 12:28:14.506230 dv-cinder-856463-4-iscsi devstack@n-api.service[105407]: Gracefully killing worker 2 (pid: 105407)... Sep 22 12:28:14.631416 dv-cinder-856463-4-iscsi devstack@n-api.service[105406]: DEBUG dbcounter [-] [105406] Writing DB stats nova_api:SELECT=4 {{(pid=105406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:28:15.506528 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: worker 1 buried after 1 seconds Sep 22 12:28:15.507063 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: worker 2 buried after 1 seconds Sep 22 12:28:15.507063 dv-cinder-856463-4-iscsi devstack@n-api.service[105405]: goodbye to uWSGI. Sep 22 12:28:15.508125 dv-cinder-856463-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 22 12:28:15.508703 dv-cinder-856463-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 22 12:28:15.511478 dv-cinder-856463-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 22 12:28:15.520865 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 22 12:28:15 2022] *** Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: nodename: dv-cinder-856463-4-iscsi Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: machine: x86_64 Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: clock source: unix Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: pcre jit disabled Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: detected number of CPU cores: 4 Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: current working directory: / Sep 22 12:28:15.522860 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: detected binary path: /usr/bin/uwsgi-core Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: your processes number limit is 47680 Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: your memory page size is 4096 bytes Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: detected max file descriptor number: 2048 Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: lock engine: pthread robust mutexes Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: thunder lock: enabled Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 22 12:28:15.523663 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 22 12:28:15.566228 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: Python main interpreter initialized at 0x5621e6cd29c0 Sep 22 12:28:15.566228 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: python threads support enabled Sep 22 12:28:15.566228 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: your server socket listen backlog is limited to 100 connections Sep 22 12:28:15.566228 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: your mercy for graceful operations on workers is 90 seconds Sep 22 12:28:15.566670 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: mapped 403077 bytes (393 KB) for 2 cores Sep 22 12:28:15.566670 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: *** Operational MODE: preforking *** Sep 22 12:28:15.566960 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: *** uWSGI is running in multiple interpreter mode *** Sep 22 12:28:15.566960 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: spawned uWSGI master process (pid: 120587) Sep 22 12:28:15.567162 dv-cinder-856463-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 22 12:28:15.567781 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: spawned uWSGI worker 1 (pid: 120603, cores: 1) Sep 22 12:28:15.568343 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: spawned uWSGI worker 2 (pid: 120604, cores: 1) Sep 22 12:28:15.568689 dv-cinder-856463-4-iscsi devstack@n-api.service[120587]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 22 12:28:16.226993 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 12:28:16.227769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 22 12:28:17.407641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:28:17.407641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: from cryptography.utils import int_from_bytes Sep 22 12:28:17.408395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:28:17.408395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Sep 22 12:28:17.408813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:28:17.408813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: from cryptography.utils import int_from_bytes Sep 22 12:28:17.408959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 22 12:28:17.408959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: from cryptography.utils import int_from_bytes Sep 22 12:28:19.841376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:28:19.842372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:28:19.843114 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:28:19.843714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:28:19.844185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:28:19.844809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.844963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 22 12:28:19.845447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.845865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 22 12:28:19.846003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.846368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.846826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.846976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 22 12:28:19.847319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.847671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 22 12:28:19.847793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.848190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 22 12:28:19.848334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.848737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.848917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.849574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.849759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-4-iscsi {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.850899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.851053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.851213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.851636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.851801 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.851966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852596 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.852894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.853030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.853527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.853649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856463-4-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.853979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.854261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.854576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.854772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.854990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.855342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.855559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.855682 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.855980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.856146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.856285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.856617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.856873 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.857085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.857315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.857528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.857771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.857985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-4-iscsi {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.858243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.858495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.858699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.858913 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.859132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.859336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.859557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.859773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.859961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.860151 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.860375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.860535 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.860720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.860877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.861947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862100 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862250 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856463-4-iscsi {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862576 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.862903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863358 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.863798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.865383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.865609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.865779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.866365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.866592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.866592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.866592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867332 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.867935 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.868910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869370 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869663 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869813 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.869956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870271 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870709 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.870857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.871881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.872983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873422 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.873876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874160 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874311 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.874900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875553 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.875860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.876002 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.876640 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.876794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.876935 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.877082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.877225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.877365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.877514 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.877656 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.878912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879654 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.879934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.880914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.881939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.882097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.882813 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.882959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.883100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.883241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.883392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.883536 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.883964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884256 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.884914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885623 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.885918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.886067 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.886208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.886773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.886925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.887983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888283 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.888899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889514 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889661 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.889817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890678 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890678 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.890951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.891976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892485 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.892923 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893239 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893394 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.893884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894770 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.894921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.895063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.895220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.895372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.895564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.896278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.896875 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.897044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.897195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.897338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.897489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.897645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.897786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.897926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.898087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.898238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.898393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.898541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.898690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.898839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.898980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.899120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.899270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.899411 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.899562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.899709 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.899851 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.900013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.900167 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.900333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 22 12:28:19.900492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.900641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.900782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.900929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901667 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.901975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.902887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.903924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.904877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905018 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905316 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.905967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.906107 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.906247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.906396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.906539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907377 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.907965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.908877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.909024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.909172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.909313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.912946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913500 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913665 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.913902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914142 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.914913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.915962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916424 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.916949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917027 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.917702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.918292 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.918292 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.918292 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.918292 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.918591 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.920333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.920527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.920527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.920826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.920971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.921992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922142 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922294 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.922866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.923994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924149 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924629 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.924929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.925070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.925218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.925377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.925539 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.925846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926159 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926465 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.926977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.927444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.927610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.927772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.927921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.928868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.929029 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.929205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.929440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930343 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930493 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.930945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.931223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.931402 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.931554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.931704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.931851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932501 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932660 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.932972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.933299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.933466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.933723 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.933892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934821 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.934971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.935937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.936098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.936277 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.936974 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.937138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.937680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.937926 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938094 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938541 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.938995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.939152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.939307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.939482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.939754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.939922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940411 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.940882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941491 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.941991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.942139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.942295 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.942444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.943194 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.943457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.943735 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.944869 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.945016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.945164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.945390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.945548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.945831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946201 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946351 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946514 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946514 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.946961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.947120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.947267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.947446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948523 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948829 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.948987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949136 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.949945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950241 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.950857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.951940 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952768 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.952921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953223 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.953936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.954850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955479 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.955943 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.956132 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.956310 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.956477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.956643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.957134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.957290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.957453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.957637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.958014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.958850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959490 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.959941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.960906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961056 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.961985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.962141 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.962372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.962535 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.962693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.962842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.963014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.963657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.963828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.963979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.964937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965566 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965726 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.965882 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.966856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967640 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.967830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.968183 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.968515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.968741 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.968901 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.969894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.970122 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.970281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.970443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.970599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.974259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.974460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.974655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.974824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.974984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975143 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975294 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975611 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.975942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.976092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.976287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.976720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.976886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.976886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.977187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.977336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.977484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.977652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.977860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.978055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.978336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.978523 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.978523 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.978839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979394 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979551 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.979856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980152 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.980861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981018 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981480 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.981938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982245 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.982856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983167 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.983941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.984090 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.984237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.984409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.984849 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.985938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986965 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.986965 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.987260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.987408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.987570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.987719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.987887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988671 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.988990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.989146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.989296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.989522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.989687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.989852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990002 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.990933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991379 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.991991 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992138 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.992963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.993914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994542 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994691 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.994847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995014 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.995945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996103 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996650 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.996957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.997903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998216 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.998984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999306 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:19.999918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.000878 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.001942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.002237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.002237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.002608 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.002764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.002920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003550 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.003991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.004972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.005713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.005834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.005928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006100 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006194 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006295 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006866 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.006954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007123 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.007977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008723 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.008934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009023 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009681 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.009986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010456 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010535 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010686 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.010987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.011977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012479 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012562 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.012970 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013348 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.013960 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014609 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.014922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015093 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015343 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015603 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015875 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.015959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016567 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016679 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016875 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.016961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.017971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.018960 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.019991 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.020762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021428 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021678 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.021904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022621 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022712 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.022996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023081 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.023994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024163 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024398 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024712 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.024816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025128 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025631 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.025936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026031 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026353 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026875 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.026974 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.027891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.028863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029072 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029480 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.029805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.030808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031012 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031678 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.031959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.032948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.033171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.033283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.033505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.033726 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.033828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034163 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034681 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.034775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.035449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.035601 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.035729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.035844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.035955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036535 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.036902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037288 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.037907 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038251 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038780 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.038886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.039835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.040997 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041091 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.041935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042561 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.042977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.043908 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044788 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.044880 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045102 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.045831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.046048 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.046253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.046572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.046675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.046912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047227 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.047952 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048256 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048623 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.048940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049148 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.049879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.050852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051346 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051654 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.051775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.052915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053123 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053753 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.053847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054164 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.054804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055325 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055426 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055739 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.055945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.056896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.057909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058448 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.058848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059367 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.059931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060679 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.060895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061632 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.061961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062277 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.062899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063105 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.063841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064041 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.064781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065367 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.065898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.066866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.067100 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.067183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.067421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.067529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.068275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.068384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.068626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.068720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.068936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069644 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.069999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070193 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.070931 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.071102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.071203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.071412 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.071549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.071742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.072892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.073820 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074023 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074125 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074739 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.074962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075367 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.075917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076233 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076681 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.076982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.077909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078144 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078560 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.078865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079508 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.079815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.080957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.081961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082297 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082613 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082728 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.082923 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.083028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.083285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.083912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.084852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085073 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.085785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086105 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.086924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.087986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.088883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.089992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090121 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.090913 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091515 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.091909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092148 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092601 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092813 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.092916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.093858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094071 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.094805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.095980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.096933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097060 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097233 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097543 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097664 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097869 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.097991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098498 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098838 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.098963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.099169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.099493 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.099612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.099809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.099971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100121 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.100929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.101083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.101222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.101797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.102110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.102426 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.102734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.103962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.104959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105174 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105283 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.105883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106096 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106550 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.106869 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107190 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.107855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108389 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.108814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109350 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109457 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109595 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:28:20.109689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.109985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.110302 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.110619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.110937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.111253 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.111569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.111887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.112221 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.112575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.112888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.113220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.113541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.113864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.114186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.114528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.114865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.115179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.115494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.115810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.116123 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.116460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.116783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.117096 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.117410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.117731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.118049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.118382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.118715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.119030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.119360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.119693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.120044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.120382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.120733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.121064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.121384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.121698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.122010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 22 12:28:20.122255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 22 12:28:20.171324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Registered counter for database nova_api Sep 22 12:28:20.183864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Registered counter for database nova_api Sep 22 12:28:20.191324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.198590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.204070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.211334 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.254626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.context [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42be6b44-0984-4460-8191-0bf6d60d534a(cell1) {{(pid=120604) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 12:28:20.259078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:28:20.259548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:28:20.261170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:28:20.261886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:28:20.262328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:28:20.264332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:28:20.266311 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Registered counter for database nova_cell0 Sep 22 12:28:20.267081 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.context [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),42be6b44-0984-4460-8191-0bf6d60d534a(cell1) {{(pid=120603) load_cells /opt/stack/nova/nova/context.py:464}} Sep 22 12:28:20.270301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Registered counter for database nova_cell1 Sep 22 12:28:20.271729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:28:20.272210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:28:20.273905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:28:20.274549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:28:20.274997 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:28:20.277048 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:28:20.278266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.279112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Registered counter for database nova_cell0 Sep 22 12:28:20.280177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.283222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Registered counter for database nova_cell1 Sep 22 12:28:20.286447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.288911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.290544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.292866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.297894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.300614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.439085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO dbcounter [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Registered counter for database nova_cell0 Sep 22 12:28:20.446438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_db.sqlalchemy.engines [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.449529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO dbcounter [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Registered counter for database nova_cell0 Sep 22 12:28:20.451282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writer thread running {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.460434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_db.sqlalchemy.engines [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 22 12:28:20.465075 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writer thread running {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 22 12:28:20.774234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:28:20.781544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:28:20.783503 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:28:20.791730 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:28:21.131783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:28:21.137870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: WARNING keystonemiddleware.auth_token [None req-82b48b26-053c-42ad-bb57-c9f968aaae41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:28:21.139710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 22 12:28:21.143184 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621e6cd29c0 pid: 120604 (default app) Sep 22 12:28:21.146255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: WARNING keystonemiddleware.auth_token [None req-960bdecf-2dc5-48a6-925a-cbfa8896f5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 22 12:28:21.154555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621e6cd29c0 pid: 120603 (default app) Sep 22 12:28:57.346078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:28:57.347052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:28:57.347912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:28:57.349232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:28:58.432519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c76480ca-e1f6-4fa1-9ffc-fe983f940623 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Action: 'create', calling method: .version_select at 0x7f107ab7c430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1117872910", "metadata": {"Type": "work"}}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:00.090043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c76480ca-e1f6-4fa1-9ffc-fe983f940623 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.753226 Sep 22 12:29:00.092079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 22 12:28:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2757 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 12:29:00.468235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3a3290a5-0f64-456c-9ccb-2c5ed17a84bf tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Calling method '.version_select at 0x7f107ac2af70>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:00.509280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:00.510462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:00.511320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:00.513521 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:01.402186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3a3290a5-0f64-456c-9ccb-2c5ed17a84bf tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e" status: 200 len: 354 microversion: 2.1 time: 1.298074 Sep 22 12:29:01.403587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:29:00 2022] GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e => generated 354 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:01.419626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3b4edec6-92eb-47cb-840c-1e3bf6e997aa tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Calling method '.version_select at 0x7f107aa51310>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:01.865962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3b4edec6-92eb-47cb-840c-1e3bf6e997aa tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e" status: 200 len: 354 microversion: 2.1 time: 0.453137 Sep 22 12:29:01.866564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:29:01 2022] GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e => generated 354 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:01.886653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6e822df7-c2a8-407b-a168-519b3eb57093 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Calling method '.version_select at 0x7f107aa2b3a0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:02.045322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6e822df7-c2a8-407b-a168-519b3eb57093 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e" status: 202 len: 0 microversion: 2.1 time: 0.162692 Sep 22 12:29:02.051994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:29:01 2022] DELETE /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:29:02.059927 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38a88a85-db69-4643-9b24-cacefa969422 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Calling method '.version_select at 0x7f107aa519d0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:02.163407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38a88a85-db69-4643-9b24-cacefa969422 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e" status: 200 len: 353 microversion: 2.1 time: 0.107028 Sep 22 12:29:02.164422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:29:02 2022] GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:03.179254 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1278409f-de9b-4bd1-bb0c-aee860862893 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Calling method '.version_select at 0x7f107aa2b550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:03.225515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-1278409f-de9b-4bd1-bb0c-aee860862893 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] HTTP exception thrown: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1278409f-de9b-4bd1-bb0c-aee860862893 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Request method failure captured: Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e HTTP/1.1 Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUJjtRZEDqk7OuhFihf2SK1Uynj-oBEEw9B1PN12jbn_19Kt-Cdi3AgxTumVPdlNu6oNz_5ckx0diOa4QefY8xOeiequecP0pZmVRAEBKOlou3x9QJZLP83VH12PyVFkg-0GsyXN9pRiKMIC1vsfH7oyAp4f79I-tP-iyY-Xmp6wgk Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: e47fbc746f4c4c3c8a1adfd454035fce Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesGetTestJSON-794174961 Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:29:03.230505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47fbc746f4c4c3c8a1adfd454035fce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e47fbc746f4c4c3c8a1adfd454035fce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e47fbc746f4c4c3c8a1adfd454035fce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e47fbc746f4c4c3c8a1adfd454035fce"}]}] Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesGetTestJSON-794174961 Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: e47fbc746f4c4c3c8a1adfd454035fce Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesGetTestJSON-794174961 Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesGetTestJSON-794174961-project Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 78ae9d0f1ba04d10ac840829b4236370 Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesGetTestJSON-794174961-project Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '7217c532-022c-486a-b83b-c839e8c0329e'} Sep 22 12:29:03.231798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. (HTTP 404) (Request-ID: req-abeb89f2-9654-4f12-836c-4c772e3c5c1d) Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:29:03.232586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:29:03.233717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 12:29:03.235127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. Sep 22 12:29:03.236212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:29:03.236964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1278409f-de9b-4bd1-bb0c-aee860862893 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] Returning 404 to user: Volume 7217c532-022c-486a-b83b-c839e8c0329e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:29:03.240499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1278409f-de9b-4bd1-bb0c-aee860862893 tempest-VolumesGetTestJSON-794174961 tempest-VolumesGetTestJSON-794174961-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e" status: 404 len: 109 microversion: 2.1 time: 0.063720 Sep 22 12:29:03.240499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:29:03 2022] GET /compute/v2.1/os-volumes/7217c532-022c-486a-b83b-c839e8c0329e => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:29:10.025832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1912130048", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "networks": [{"uuid": "00c667b7-ed04-4735-ad4f-fba2a6edba76"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:10.266430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] validate_networks() for [('00c667b7-ed04-4735-ad4f-fba2a6edba76', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:29:11.843439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:29:11.846017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:29:11.846708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:29:11.848810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:29:11.850210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:29:11.898615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:11.899457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:11.900062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:11.900972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:11.901567 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:11.902131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:12.014957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Getting quotas for project acfd00e7112b409bba3cdf9480508b02. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:12.022318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Getting quotas for user e125a85011fe402ab2d5782d8fd39dfc and project acfd00e7112b409bba3cdf9480508b02. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:12.037743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:29:12.040683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:29:12.175945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c941ebe5-92db-4701-be86-ef5eb4997757 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685129 Sep 22 12:29:12.179535 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 4/7] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:29:12.192083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2cfe7e39-73a4-459b-9f1b-b9c1bce17bda tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:12.193086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2cfe7e39-73a4-459b-9f1b-b9c1bce17bda tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:12.447734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2cfe7e39-73a4-459b-9f1b-b9c1bce17bda tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:12.488452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2cfe7e39-73a4-459b-9f1b-b9c1bce17bda tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1215 microversion: 2.1 time: 0.300803 Sep 22 12:29:12.500776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:12 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:13.520495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-15f91637-0508-454c-91d4-612096214593 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:13.522646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-15f91637-0508-454c-91d4-612096214593 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:13.809048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-15f91637-0508-454c-91d4-612096214593 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:13.865626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-15f91637-0508-454c-91d4-612096214593 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1215 microversion: 2.1 time: 0.348409 Sep 22 12:29:13.867360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:13 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1215 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:14.892856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:14.893263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:14.925578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:14.938431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:14.940439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:14.942367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:14.946534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:14.952560 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:15.695896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:15.733591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70b1649e-c7b3-400c-a717-86b0a9c3f3fc tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1211 microversion: 2.1 time: 0.845024 Sep 22 12:29:15.747218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:14 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1211 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:16.764047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:16.764630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:16.797888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:16.798391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:16.800208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:16.801027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:16.810781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:16.811592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:17.788609 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:17.813729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e85582bb-6ba3-46cf-9390-fb3dbb306eff tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1273 microversion: 2.1 time: 1.053846 Sep 22 12:29:17.814318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:16 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1273 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:17.988809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-428707024", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:18.314251 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] validate_networks() for [('8db57afe-6ac0-4ca9-95e4-169c6f6e837a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:29:18.858776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:18.859428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:18.881453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:18.885400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:18.892256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:18.897238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:18.898095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:18.900410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:19.236004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:19.254314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-93aaa3de-141e-47ce-8c06-a645ff8c1df2 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1273 microversion: 2.1 time: 0.399098 Sep 22 12:29:19.255247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:18 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1273 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:19.395762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9715643-fe5e-4400-bdd1-c61371a05771 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: .version_select at 0x7f107a050940>, body: {"keypair": {"name": "tempest-keypair-1419290831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8N1leh8cnq4NzWVmEabfvCXLa5WFIdIQFw0FM//1KcqNXY96NRf4o5Bj5FBnxl8tJw84kz9KVTA6nWs/Ury45uckHbnEAqBE2bVylrMw4iXwUe8bN3mXt7fAPSdfXXg=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:19.496803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e9715643-fe5e-4400-bdd1-c61371a05771 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:19.528270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e9715643-fe5e-4400-bdd1-c61371a05771 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:19.643291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e9715643-fe5e-4400-bdd1-c61371a05771 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.386721 Sep 22 12:29:19.646796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 8/13] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:29:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:20.281064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:20.281836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:20.295794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:20.296320 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:20.297524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:20.299647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:20.300125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:20.300712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:21.472005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:21.481786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-947d2643-cea7-49cd-830e-89aec3ad8bcb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1273 microversion: 2.1 time: 1.204515 Sep 22 12:29:21.482376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 9/14] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:20 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1273 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:22.488003 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:22.510181 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:22.511362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:22.522166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:22.523860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:22.526803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:22.527480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:22.531769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:22.548462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:22.554713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:22.716879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:29:22.717222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:29:22.717849 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:29:22.718417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:29:22.718988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:29:22.765995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:22.770984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:22.774295 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:22.776591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:22.778575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:22.781576 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:22.922672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:22.951192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for user 0847f00afbde44068fcf1cedbce24be5 and project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:22.997499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:29:23.007292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:29:23.198499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2abd0f30-08b1-475c-a9bc-6f5fbd204e7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.419671 Sep 22 12:29:23.199151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 6/15] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:29:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 6422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 12:29:23.243065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:23.256434 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a0ec3062-ffa2-4f65-a0f0-f7c4c814f75d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1273 microversion: 2.1 time: 0.748332 Sep 22 12:29:23.265055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 10/16] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:22 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1273 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:23.286458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b078fa4b-1980-4d6e-9047-433cf910ed86 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:23.287684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b078fa4b-1980-4d6e-9047-433cf910ed86 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:23.506775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b078fa4b-1980-4d6e-9047-433cf910ed86 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:23.514476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b078fa4b-1980-4d6e-9047-433cf910ed86 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1221 microversion: 2.1 time: 0.248281 Sep 22 12:29:23.520563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 11/17] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:23 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:24.192884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0f991fe-e8ad-4414-998e-ddbb723627aa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: .version_select at 0x7f1079fa7af0>, body: {"keypair": {"name": "tempest-keypair-633784274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiLuRfKRpv0KHhxA54TmS0ObT1SYXUoyo8VfnfbciqfixQInU/jRv5RaM/ref5V/BUaSPWB9lJ32gwmPDja+vDfVmFK6YYgGqZ6cPsc1wTBls4zopJUXPV7bJ7erYN9KA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:24.288565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:24.289423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:24.305948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:24.306453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:24.306898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:24.320462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:24.320961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:24.321414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:24.335666 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-e0f991fe-e8ad-4414-998e-ddbb723627aa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for project 89fe74d1d646452e83cb93420766c0a2. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:24.360215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-e0f991fe-e8ad-4414-998e-ddbb723627aa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for user 49c772b0c2bb49a4ab4048d980bd20a8 and project 89fe74d1d646452e83cb93420766c0a2. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:24.480045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0f991fe-e8ad-4414-998e-ddbb723627aa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.275315 Sep 22 12:29:24.480698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 7/18] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:29:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:24.506897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-601439142", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:24.655872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] validate_networks() for [('8db57afe-6ac0-4ca9-95e4-169c6f6e837a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:29:25.313780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:25.339387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4f80fa55-8c6b-4f93-a1d1-3c71232dc5b6 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 1.045818 Sep 22 12:29:25.347476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 12/19] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:24 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:25.359008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1943819541", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd"}], "security_groups": [{"name": "tempest-securitygroup--1924634476"}], "key_name": "tempest-keypair-1419290831", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:25.791054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] validate_networks() for [('a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:29:27.265748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:29:27.266755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:29:27.267396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:29:27.267967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:29:27.268556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:29:27.290311 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.290806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.291246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.291972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.312610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.313212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.387685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:27.411161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for user 0847f00afbde44068fcf1cedbce24be5 and project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:27.466628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:29:27.470895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:29:27.495872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:29:27.496520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:29:27.496786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:29:27.497188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:29:27.497858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:29:27.515920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.518988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.519899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.522411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.524714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.526625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.603696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:27.622337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4caaf118-3aa1-4997-8c01-60087a6312c8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.134263 Sep 22 12:29:27.629429 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 8/20] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:29:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:29:27.634080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:27.645542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:27.646409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:27.671806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.686775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:29:27.694680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:29:27.699883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.700449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.709362 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:27.712360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:27.713603 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:27.957519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2b812317-49a6-474d-8752-7f5736f55c53 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.604678 Sep 22 12:29:27.961772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 13/21] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:29:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:29:27.989596 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7748c85c-8f8a-4361-adf1-bb9c22da0610 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:27.993562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7748c85c-8f8a-4361-adf1-bb9c22da0610 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:28.528155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7748c85c-8f8a-4361-adf1-bb9c22da0610 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:28.541743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7748c85c-8f8a-4361-adf1-bb9c22da0610 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1221 microversion: 2.1 time: 0.577056 Sep 22 12:29:28.568877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 14/22] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:27 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1221 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:28.610147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0ecf48e4-0f27-406a-bc29-dde6700c151d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:28.629525 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0ecf48e4-0f27-406a-bc29-dde6700c151d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:29.109977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0ecf48e4-0f27-406a-bc29-dde6700c151d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:29.121192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0ecf48e4-0f27-406a-bc29-dde6700c151d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1242 microversion: 2.1 time: 0.529845 Sep 22 12:29:29.127502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 15/23] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:28 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1242 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:29.577656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:29.593982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2a974de-c691-43db-be72-8493e9b17ba5 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 1.963081 Sep 22 12:29:29.594661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:29.595304 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:29.603850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 9/24] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:27 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:29.619142 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:29.619646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:29.620093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:29.620944 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:29.621402 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:29.623019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:29.994246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:30.008184 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-31662696-6ea2-401e-81d5-0fd3fc23c061 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1217 microversion: 2.1 time: 0.417085 Sep 22 12:29:30.026018 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 16/25] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:29 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1217 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:30.151289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:30.152266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:30.168142 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:30.172682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:30.174255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:30.177590 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:30.181727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:30.182182 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:30.630091 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:30.630880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:30.641335 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:30.649223 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:30.651718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:30.652729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:30.655244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:30.656807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:31.140931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:31.158970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-71a42be3-c07f-4028-b5be-c04bff161e2d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1238 microversion: 2.1 time: 1.011773 Sep 22 12:29:31.182631 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 10/26] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:30 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1238 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:31.189554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1601142079", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa4f03ac-0d51-4ef1-9086-3b2b84cb717e"}], "security_groups": [{"name": "tempest-securitygroup--1764544484"}], "key_name": "tempest-keypair-633784274", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:32.879111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] validate_networks() for [('fa4f03ac-0d51-4ef1-9086-3b2b84cb717e', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:29:33.327503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:33.363217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-02582d7d-4998-4ad2-9877-9032f3a7f0a0 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 2.741619 Sep 22 12:29:33.378210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 17/27] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:30 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 2757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:33.407507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:33.410316 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:33.437720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:33.438578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:33.439210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:33.441906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:33.448404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:33.449080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:33.814423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:33.827132 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d7715dc7-610c-4306-a3be-a0cc0defec54 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1279 microversion: 2.1 time: 0.446975 Sep 22 12:29:33.850070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 18/28] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:33 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1279 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:33.887016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:33.892108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:33.918414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:33.922655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:33.923651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:33.933221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:33.934318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:33.934805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:34.243693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:34.253071 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b18364fb-c633-447f-9b53-3b8374f00125 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1300 microversion: 2.1 time: 0.384556 Sep 22 12:29:34.258980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 19/29] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:33 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1300 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:34.394996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:34.395951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:34.414250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:34.414752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:34.415427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:34.417123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:34.422807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:34.424914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:35.843546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:35.861548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c9a1e62a-4829-4a30-a33a-07e9380f2596 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 1.470873 Sep 22 12:29:35.862825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 20/30] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:34 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:35.883768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:35.884737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:35.928814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:35.935831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:35.936347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:35.941438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:35.944180 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:35.949019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:36.446452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:29:36.447031 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:29:36.447402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:29:36.447866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:29:36.448284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:29:36.474641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:36.477645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:36.478350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:36.480765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:36.482178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:36.483217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:36.570913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for project 89fe74d1d646452e83cb93420766c0a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:29:36.584117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for user 49c772b0c2bb49a4ab4048d980bd20a8 and project 89fe74d1d646452e83cb93420766c0a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:29:36.642661 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:29:36.646082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:29:36.729871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4a77db7c-2319-4b32-8be9-fad381c704f9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.546062 Sep 22 12:29:36.730722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 11/31] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:29:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 5548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:29:36.744460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:36.745460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:36.767036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:36.768161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:36.769387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:36.770284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:36.770904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:36.771484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.002749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:37.014926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-db3700e1-a1dc-4d6e-8424-cbc30e0de788 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1300 microversion: 2.1 time: 0.274807 Sep 22 12:29:37.018076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 12/32] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:36 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:37.129978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:37.140096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d2ec4a89-aa2c-447a-9da0-42f8888c56ed tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 1.260112 Sep 22 12:29:37.142879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 21/33] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:35 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:37.150096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-232c6736-643c-40c5-9e85-a0060697de8b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:37.153094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-232c6736-643c-40c5-9e85-a0060697de8b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:37.289818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e388d2-8f9f-483b-8b65-1abf586e7910", "tag": "63348aca-86db-4bd1-aed7-9cad6b48e679"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:37.319695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.320266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.320798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.354049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Creating event network-changed:63348aca-86db-4bd1-aed7-9cad6b48e679 for instance f7e388d2-8f9f-483b-8b65-1abf586e7910 on hv-cinder-85646 Sep 22 12:29:37.354671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 12:29:37.355272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f0b3abbc-4054-4e60-b3c9-a8311ba80714 req-d55739ac-b8f8-4b4e-b268-e8cb6ef21000 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 12:29:37.356434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.357000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.357500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.358283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.358809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.359622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.372774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.compute.rpcapi [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 12:29:37.373782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] Releasing lock "compute-rpcapi-router" {{(pid=120603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 12:29:37.403912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6f834fef-7a7b-42fc-8800-db238ff01889 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382990 Sep 22 12:29:37.405122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 13/34] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:37.413571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:37.414404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:37.422278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.422845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.423347 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.424166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.424710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.425371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.464332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-232c6736-643c-40c5-9e85-a0060697de8b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:37.476087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-232c6736-643c-40c5-9e85-a0060697de8b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1237 microversion: 2.1 time: 0.331006 Sep 22 12:29:37.490860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 22/35] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:37 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1237 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:37.559524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:37.630702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "788e8c2c-8b83-46fe-8728-92c6b755c9c8", "tag": "a1cada3c-6838-41ff-aa19-94a5eda38089"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:37.658574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.659877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.660935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.696977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Creating event network-changed:a1cada3c-6838-41ff-aa19-94a5eda38089 for instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 on hv-cinder-85646 Sep 22 12:29:37.697291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 22 12:29:37.697678 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-5a4403c0-48ad-4534-b5a9-873754f9fc3d req-de765961-d817-43f4-9f60-e9a2fac64b0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 22 12:29:37.705024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.705576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.708555 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.711888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:37.714799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:37.714799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:37.726130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.compute.rpcapi [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 22 12:29:37.734364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] Releasing lock "compute-rpcapi-router" {{(pid=120604) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 22 12:29:37.766437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-11767a75-d672-463e-a11e-0a5e8c0a2cd6 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268318 Sep 22 12:29:37.767336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 23/36] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:37.923581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:37.946283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fd7c40c-3c14-4b12-a90d-cfff9db84f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.535396 Sep 22 12:29:37.948823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 14/37] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:37 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:38.047560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:38.048335 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:38.066751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.068916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.069379 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.070859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.071331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.071907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.191371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:38.191916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:38.230036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.230945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.231736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.235884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.236653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.241897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.608216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:38.619188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c64842c0-8a8c-42ae-8b8f-dac8a9ffc798 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.577429 Sep 22 12:29:38.620549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 24/38] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:38 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:38.625341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:38.626120 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:38.633399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.634089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.634693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.635378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.636350 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.637067 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.654225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:38.662703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-66703b1c-04a8-4c46-b3ac-233f710cf9c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.496712 Sep 22 12:29:38.680330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 15/39] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:38 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:38.718322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:38.727189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ed257078-25c4-4cfc-85f9-d7ad548cf65d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1241 microversion: 2.1 time: 0.105129 Sep 22 12:29:38.729587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 25/40] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:38 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:38.974491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:38.975699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:38.986139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.986751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.987263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:38.988201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:38.988888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:38.989386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.136377 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:39.144393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-112ca1e8-7c5b-4e68-9f5f-1b87ed282f1e tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.175027 Sep 22 12:29:39.145200 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 16/41] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:38 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:39.471224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f8b6d4-4a92-4a94-a7d2-23435c651c4d", "tag": "59f4c935-e132-4169-a0e6-2552ac665c8d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:39.492891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.493552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.493897 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.501024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=87 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:39.514481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] Creating event network-changed:59f4c935-e132-4169-a0e6-2552ac665c8d for instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d on hv-cinder-85646 Sep 22 12:29:39.520354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-4db22237-3af2-4d8c-abe4-fbad47866ef8 req-dac5110a-66e2-429c-96e3-c18fe091bfba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053104 Sep 22 12:29:39.521499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 26/42] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:39.642417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:39.643054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:39.649264 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.649761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.650202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.650902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.651520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.651952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.694360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:39.695613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:39.698937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:39.703442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.709157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.709857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.710873 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.711511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.712234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.841672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:39.850932 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e807b311-2f0c-4d1f-854d-36286d24688c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.212501 Sep 22 12:29:39.851505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 17/43] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:39 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:39.873760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:39.874388 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:39.881794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.881794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.881794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.882104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:39.882474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:39.883049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:39.945952 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:39.955661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-22541b52-98b1-4169-88c9-4d7aafe98d6a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.265189 Sep 22 12:29:39.957228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 27/44] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:39 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:39.997314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:40.005762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a0d06ac-80f9-401f-a59b-4c54ea2ed96c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1241 microversion: 2.1 time: 0.140187 Sep 22 12:29:40.006352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 18/45] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:39 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:40.167747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:40.168687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:40.175225 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:40.175994 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:40.176382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:40.177393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:40.178002 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:40.178421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:40.768670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:40.777868 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-431cb8f2-fb90-4d7a-98c7-f8d5ecde1f74 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.614805 Sep 22 12:29:40.778821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 28/46] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:40 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:40.873524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:40.874344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:40.883866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:40.884548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:40.885160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:40.886365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:40.887111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:40.887991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:40.985976 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:40.986642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:40.995586 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:40.996674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:40.997402 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:41.007884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:41.008584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:41.009189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:41.287755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:41.295790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-115e7a89-5a4c-4fe6-8837-8ef1f082b3af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.426175 Sep 22 12:29:41.296695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 19/47] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:40 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:41.310728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:41.311494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:41.318768 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:41.319357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:41.319918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:41.320677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:41.321204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:41.321699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:41.421958 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:41.437006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7c599f6b-eb12-4ce7-bf4b-077c9ef02362 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1289 microversion: 2.1 time: 0.138627 Sep 22 12:29:41.438508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 20/48] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:41 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:41.455477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:41.464063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-03a22288-b91e-4bbd-b226-59304ba81d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.483745 Sep 22 12:29:41.464899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 29/49] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:40 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:41.800578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:41.801460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:41.808126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:41.808878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:41.809530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:41.810306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:41.810971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:41.811462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.077273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:42.085451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8de9f83c-9485-43b4-babe-2e8185bc085a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.288764 Sep 22 12:29:42.086744 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 21/50] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:41 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:42.133916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac05188-579c-4644-89f8-233e046b4618", "tag": "3ccdb191-e1dc-4383-95e0-0dda555c85b6"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:42.146888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.147641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.148378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.160929 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] Creating event network-changed:3ccdb191-e1dc-4383-95e0-0dda555c85b6 for instance 9ac05188-579c-4644-89f8-233e046b4618 on hv-cinder-85646 Sep 22 12:29:42.166369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-924098e5-dea2-4e6f-a7f9-c3fb13faa073 req-badb1606-1abf-4693-88f0-1006f6651ee4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037749 Sep 22 12:29:42.166977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 30/51] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:42.322494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:42.323132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:42.325238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:42.332739 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.333415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.334164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.335077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.335801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.336482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.342277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=83 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:42.468708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:42.469482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:42.501584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.503703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.509215 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.509997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.515855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.516419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.827157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:42.840460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2c9bfb13-a0b8-4df8-8ff6-f81fd9d1d5bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1289 microversion: 2.1 time: 0.382689 Sep 22 12:29:42.841833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 31/52] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:42 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1289 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:42.856169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:42.857920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:42.881628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.882125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.882716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.883476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:42.886430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:42.887116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:42.953682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:42.962752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23c9b39c-fc1b-48cd-969d-b1c040b2b305 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.644007 Sep 22 12:29:42.966497 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 22/53] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:42 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:43.109279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:43.109894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:43.118720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:43.119215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:43.119727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:43.125073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:43.125976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:43.127177 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:43.727772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:43.741838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d1718c7c-704b-4ea4-a174-ac3902b9455e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.893886 Sep 22 12:29:43.749126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 32/54] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:42 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:43.813608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:43.832746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-571a9997-428d-429f-a57b-8605bb396e0d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.727160 Sep 22 12:29:43.833415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 23/55] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:43 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:43.869865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:43.870830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:43.880449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:43.881165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:43.881812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:43.882743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:43.883452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:43.884096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:43.994507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:43.995898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:44.006500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.007090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.010252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:44.014800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:44.019527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-82a60687-1246-49f6-ab63-887bf647ef4a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1295 microversion: 2.1 time: 0.154425 Sep 22 12:29:44.020620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.021633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.022464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 33/56] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:43 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:44.023129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:44.477413 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:44.489946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-027f5399-4b4d-4873-85d2-2ba88c098ba8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.501083 Sep 22 12:29:44.491248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 24/57] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:43 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:44.786509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:44.787840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:44.804859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.805541 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.813438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:44.814599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.815149 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.819707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:44.862995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:44.863409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:44.882677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.885761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.886424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:44.907839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:44.908371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:44.909843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.274286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:45.284697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3956e932-d363-4b3f-94d5-b40eacd8d321 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.428776 Sep 22 12:29:45.293450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 25/58] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:44 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:45.309055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:45.311939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:45.327892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:45.328080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:45.340590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7d9794d5-b195-4d35-8f83-4569ef8710c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.562165 Sep 22 12:29:45.344213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 34/59] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:44 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:45.344385 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:45.344744 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.346496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:45.347802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:45.348474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.530631 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788e8c2c-8b83-46fe-8728-92c6b755c9c8", "name": "network-vif-plugged", "status": "completed", "tag": "a1cada3c-6838-41ff-aa19-94a5eda38089"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:45.554757 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:45.555264 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:45.555724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.592988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] Creating event network-vif-plugged:a1cada3c-6838-41ff-aa19-94a5eda38089 for instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 on hv-cinder-85646 Sep 22 12:29:45.604379 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-b65219ce-5611-4b44-a511-1340ad03b604 req-009b450b-21c9-4489-999d-f615cb2464bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183452 Sep 22 12:29:45.607433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 35/60] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:45.616589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:45.617507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:45.625661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:45.626377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:45.627030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.628470 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:45.629192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:45.629942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:45.664510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:45.681329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a9865d6b-fa4c-435b-9b6d-08473a650952 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.386132 Sep 22 12:29:45.682205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 26/61] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:45 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:45.833420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:45.857495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-88e5dc77-31e4-4db4-a3b1-39ed66a30388 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.247427 Sep 22 12:29:45.863348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 36/62] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:45 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:46.314142 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:46.315802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:46.327191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:46.331495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:46.332641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:46.333811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:46.334489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:46.335139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:46.369876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:46.371140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:46.377646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:46.387599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:46.389220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:46.392608 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:46.394580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:46.402540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:46.630248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:47.282086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:47.294680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2307fc18-39d1-4025-b79a-ea3eb5740f38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.984544 Sep 22 12:29:47.308443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 27/63] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:46 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:47.319326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:47.320215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:47.330676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:47.335779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:47.336397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:47.336847 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:47.337557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:47.341895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-059c3ed2-a926-4676-9ea6-eaac5300c0c7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.977260 Sep 22 12:29:47.357084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 37/64] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:46 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:47.357747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:47.357747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:47.357932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:47.357932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:47.368911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:47.371978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:47.373023 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:47.374195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:47.377115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:47.377503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:47.378009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:47.471463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=26 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:47.672426 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:47.686520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-340ce2e9-6220-4a0a-95cf-425a5dfdf34a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.375307 Sep 22 12:29:47.704931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 28/65] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:47 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:47.712797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e388d2-8f9f-483b-8b65-1abf586e7910", "name": "network-vif-plugged", "status": "completed", "tag": "63348aca-86db-4bd1-aed7-9cad6b48e679"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:47.724763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:47.726253 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:47.727086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:47.727600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:47.728576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:47.745467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] Creating event network-vif-plugged:63348aca-86db-4bd1-aed7-9cad6b48e679 for instance f7e388d2-8f9f-483b-8b65-1abf586e7910 on hv-cinder-85646 Sep 22 12:29:47.761812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-93c57364-948e-4ec3-b71a-38a3c0d09569 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.408345 Sep 22 12:29:47.762580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 38/66] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:47 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:47.764745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5fb263de-90e2-4679-83f8-7f53fd6cd91d req-a4bfca44-25af-46d0-bf2c-05c51dd07092 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058050 Sep 22 12:29:47.765557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 29/67] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:48.016368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee64bd-305d-44e5-a1b7-00f4ef55cf64", "tag": "e2f4672c-6d5a-4ebe-b44f-8980103a38bf"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:48.036330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.036800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.037295 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.050832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] Creating event network-changed:e2f4672c-6d5a-4ebe-b44f-8980103a38bf for instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 on hv-cinder-85646 Sep 22 12:29:48.056477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-275581fe-8bfa-41e8-afee-f186ff91417b req-c0e7f6d2-c388-44a3-8c94-232a1d85fcec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043947 Sep 22 12:29:48.056605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 39/68] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:48.320835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:48.321534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:48.327809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.328338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.328765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.332089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.332089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.332089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.368909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:48.369603 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:48.378785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.379271 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.379702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.380426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.380876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.381299 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.544189 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:48.558017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c8e0bfb4-32d4-42bf-9afe-d73abbda491d tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.241779 Sep 22 12:29:48.559737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 30/69] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:48 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:48.577275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:48.590267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0c1913e3-7dd2-449e-9c6a-b17a17132ef6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.225313 Sep 22 12:29:48.591048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 40/70] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:48 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:48.710238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:48.710875 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:48.717006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.717740 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.718149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.718999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.719618 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.720045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.793748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:48.794355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:48.802140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.803738 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.804439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.806958 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:48.807866 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:48.808731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:48.981674 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:48.989747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c979a73f-0022-4479-a368-aef6cd28f3b9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.283941 Sep 22 12:29:48.990468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 31/71] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:48 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:49.057451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:49.068039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b40bc83e-e324-43c3-9dc2-2a15b2c990b5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.284290 Sep 22 12:29:49.069478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 41/72] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:48 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:49.584963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:49.586018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:49.592260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:49.592991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:49.593563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:49.594577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:49.595296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:49.595861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:49.616915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:49.617497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:49.624718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:49.625227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:49.625656 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:49.626345 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:49.626785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:49.627202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:49.861386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:49.870032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7864c86-193b-4901-897b-3927bdf80b46 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.289544 Sep 22 12:29:49.884813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:49.885954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 32/73] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:49 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:49.886065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-99f27b56-391d-4a7d-b111-156d8c7b69b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.272663 Sep 22 12:29:49.886769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 42/74] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:49 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:50.011833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:50.012805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:50.024275 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.025041 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.025632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.026606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.027223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.027652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.095300 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:50.097324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:50.104967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.105544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.105991 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.106845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.107305 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.107732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.297416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:50.305580 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00efd7a7-8361-4158-92a0-4f43a2d66466 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.297593 Sep 22 12:29:50.306164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 33/75] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:50 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:50.347531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:50.356326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-85401d71-eb2e-4b2c-adf5-f8affb87183b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.264982 Sep 22 12:29:50.357205 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 43/76] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:50 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:50.902409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:50.903763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:50.909547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:50.910694 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:50.913138 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.913901 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.915158 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.916169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.916948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.917728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.920686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.921676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.922572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:50.923392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:50.923861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:50.924313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.201711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:51.212368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-076c9993-8f39-45fa-9148-a66aa25eadee tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.305814 Sep 22 12:29:51.229474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 44/77] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:50 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:51.231960 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:51.252451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8bf0193a-a4ab-49d7-b290-eeb1910eaacf tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.354267 Sep 22 12:29:51.253643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 34/78] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:50 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:51.335384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:51.336454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:51.344210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:51.344764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:51.345207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.347621 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:51.348129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:51.351189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.379608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:51.380667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:51.382445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:51.388328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:51.389317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:51.389898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.391971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:51.396992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:51.397749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.655917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:51.658745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:51.666626 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3a48ef2-a651-4219-bde6-e323843197b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.291620 Sep 22 12:29:51.667668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 35/79] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:51 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:51.672844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac05188-579c-4644-89f8-233e046b4618", "name": "network-vif-plugged", "status": "completed", "tag": "3ccdb191-e1dc-4383-95e0-0dda555c85b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:51.683896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:51.684936 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:51.686031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f41bbbb1-0615-4aba-a4c8-9a25fc1051ff tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.353615 Sep 22 12:29:51.686291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:51.688110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 45/80] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:51 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:51.704118 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] Creating event network-vif-plugged:3ccdb191-e1dc-4383-95e0-0dda555c85b6 for instance 9ac05188-579c-4644-89f8-233e046b4618 on hv-cinder-85646 Sep 22 12:29:51.710867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-770d6c5d-500e-4c53-8de9-02a752328201 req-ac4a1e54-dd57-4841-9b0a-1577d5ba54c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041589 Sep 22 12:29:51.711804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 36/81] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:52.236837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:52.238209 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:52.244434 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.244986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.256217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.257155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.257735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.258236 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.278444 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:52.279146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:52.290277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.292795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.296346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.297279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.297895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.298461 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.516281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:52.527199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5cf91d37-9d76-45f3-a383-3e3b4729e560 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.294267 Sep 22 12:29:52.528214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 46/82] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:52 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:52.551892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:52.561016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-20923289-0f7f-4877-87a5-0ab85f8b8c69 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.288309 Sep 22 12:29:52.562821 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 37/83] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:52 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:52.704057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:52.704961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:52.714156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.714347 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:52.715117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.715262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:52.715963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.717497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.718179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.718814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.728841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.731010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.731893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:52.733793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:52.734597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:52.735408 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:53.010022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:53.019353 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e9f22b09-400b-4229-b39f-9196dd864a6c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.319051 Sep 22 12:29:53.020528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 47/84] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:52 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:53.033045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:53.039383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-08d8314c-5af5-43e7-9de1-e6cbeabd7a9e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.330074 Sep 22 12:29:53.039952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 38/85] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:52 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:53.551295 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:53.551964 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:53.558033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:53.558514 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:53.558947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:53.559634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:53.560075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:53.560521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:53.586405 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:53.586981 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:53.593399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:53.593886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:53.594367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:53.595109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:53.595559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:53.595980 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:53.748384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:53.756778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac37df08-cd5b-4ee5-b562-5fd50f9f94a4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.209791 Sep 22 12:29:53.757651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 48/86] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:53 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:53.780967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:53.789102 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18f026a5-11b4-4a6a-a567-7816d515a8bb tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.207175 Sep 22 12:29:53.789673 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 39/87] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:53 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:54.043948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:54.044585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:54.050643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.051104 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.051534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.052212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.052690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.053112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.065993 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:54.066602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:54.072571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.073054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.073487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.074170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.074637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.075037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.079071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:29:54.239043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:54.247384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f60f3d90-ff7f-4c53-83d7-88c3106f99cb tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.207248 Sep 22 12:29:54.248328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 49/88] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:54 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:54.258136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:54.265771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4525cfd5-bcaa-4853-b3cc-1a4c9853fad8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.203617 Sep 22 12:29:54.266329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 40/89] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:54 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:54.779600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:54.780213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:54.786248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.786734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.787175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.787864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.788338 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.788769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.814770 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:54.817459 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:54.823808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.824323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.824814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.825523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:54.826009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:54.826437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:54.974818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:54.984425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-452ea4b1-ac28-4d7d-aa6b-ad7821d97830 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.209147 Sep 22 12:29:54.992383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 50/90] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:54 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:55.005410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:55.013370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0bfcc29c-9a00-4529-8b08-3c474ba52a0a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.204015 Sep 22 12:29:55.014126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 41/91] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:54 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:55.270136 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:55.270747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:55.276809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:55.277291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:55.277722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:55.278410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:55.278861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:55.279281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:55.288238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:55.288796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:55.294912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:55.295434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:55.295886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:55.296865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:55.297321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:55.297792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:55.512517 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:55.518996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-498dd3fe-75b9-49bb-97ed-e72726e46d50 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.252399 Sep 22 12:29:55.519410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 51/92] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:55 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:55.520344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:55.532059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-807298b8-f1e4-488f-863b-d3a06a917638 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.247546 Sep 22 12:29:55.536918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 42/93] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:55 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:56.006854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:56.007392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:56.013487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.014009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.014444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.015145 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.015599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.016032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.037642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:56.038296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:56.044157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.044674 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.045111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.045801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.046262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.046686 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.202610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:56.210192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bc737eb3-8b56-4f84-be47-83caf5b50044 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.207193 Sep 22 12:29:56.210751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 52/94] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:56 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:56.223456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:56.232508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5df1c916-cf66-4d85-889a-5a7bf8387fd9 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.199081 Sep 22 12:29:56.233071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 43/95] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:56 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:56.541846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:56.542385 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:56.548376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.548888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.549318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.549998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.550444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.550870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.561395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:56.562019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:56.567961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.568478 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.568915 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.569606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:56.570059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:56.570480 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:56.738298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:56.745985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a48accd0-df32-4537-a81d-a77222009c07 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.208049 Sep 22 12:29:56.746557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 53/96] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:56 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:56.760040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:56.767844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-19051add-cc77-46c0-a02a-a5ba16dc5faa tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.210222 Sep 22 12:29:56.769054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 44/97] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:56 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:57.232940 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:57.233486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:57.239907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.240417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.240853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.241533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.241988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.242412 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.255561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:57.256170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:57.262030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.262506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.262931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.263609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.264051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.264507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.430946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:57.438917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cff00e1b-2014-4b80-9f04-420dd7085357 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.209890 Sep 22 12:29:57.439632 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 54/98] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:57 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:57.453317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:57.461022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fbcff932-9a91-4f54-abeb-efacea7dad4a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.209970 Sep 22 12:29:57.461588 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 45/99] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:57 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:57.510521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f8b6d4-4a92-4a94-a7d2-23435c651c4d", "name": "network-vif-plugged", "status": "completed", "tag": "59f4c935-e132-4169-a0e6-2552ac665c8d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:29:57.520984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.521529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.521946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.532979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] Creating event network-vif-plugged:59f4c935-e132-4169-a0e6-2552ac665c8d for instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d on hv-cinder-85646 Sep 22 12:29:57.538288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-92493e19-32d8-482d-a4e8-85ed47f3f1b0 req-fd09ee1a-e986-45e6-b6a5-2f970955a3b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031528 Sep 22 12:29:57.538874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 55/100] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:29:57.769795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:57.770334 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:57.776406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.776893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.777333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.778072 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.778750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.778922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.792173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:57.793178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:57.800328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.800859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.801443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.802429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:57.803116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:57.803723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:57.968442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:57.977566 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-611b8580-e0c5-46c7-aff6-9e36f0f66669 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.212208 Sep 22 12:29:57.978130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 46/101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:57 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:57.984133 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:57.991816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-09fc25c7-17ef-4816-a022-50ded13953e3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.204427 Sep 22 12:29:57.992401 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 56/102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:57 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:58.462285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:58.462899 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:58.469151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:58.469672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:58.470104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:58.470804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:58.471253 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:58.471677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:58.483539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:58.484143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:58.490108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:58.490587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:58.491032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:58.491704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:58.492156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:58.492605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:58.668558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:58.676921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a1f6be70-c2bb-4f67-9357-7bb24f54eaa3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.218446 Sep 22 12:29:58.677074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:58.677488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 47/103] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:58 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:58.685287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7d059a58-622f-49e2-9c0c-35db34335402 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1315 microversion: 2.1 time: 0.205546 Sep 22 12:29:58.685822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 57/104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:58 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:29:59.006098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:59.006927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:59.013518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.014062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.014489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.014648 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:59.015361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:59.015500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.016110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.016734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.023410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.030688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.031147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.034666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.034666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.034666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.241399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:59.249394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57587938-db79-413d-836c-5a7a384cbaaf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.247480 Sep 22 12:29:59.250473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 48/105] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:59 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:59.263891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:59.272322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-49658db7-abee-48c5-bb31-627612385c96 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.262238 Sep 22 12:29:59.272904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 58/106] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:59 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:59.701034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:59.701647 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:59.708560 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.709365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.709994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.711210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.711845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.712643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.712826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:29:59.713440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:29:59.720607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.721102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.721597 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.722441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:29:59.722894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:29:59.723313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:29:59.926337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:59.935181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1427ebf2-48ec-42fd-9e34-392fd6d902fe tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.237949 Sep 22 12:29:59.949711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 49/107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:59 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:29:59.962207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:29:59.969910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c26fd6b5-720a-4115-ab7c-575071a6fd38 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1503 microversion: 2.1 time: 0.261564 Sep 22 12:29:59.970459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 59/108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:29:59 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:00.272059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:00.272707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:00.280736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.281253 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.282022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:00.282367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.282819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.283400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:00.303898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:00.305698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:00.312980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.313664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.314315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:00.315249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.315821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.316493 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:00.499315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:00.515544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea6ccefd-afc9-4102-98ea-cba794026411 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1368 microversion: 2.1 time: 0.247437 Sep 22 12:30:00.518999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 50/109] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:00 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:00.535161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:00.536923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a7f38e33-9151-4aec-8810-e2f17305ffa1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.241964 Sep 22 12:30:00.537473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 60/110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:00 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:00.959236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:00.959881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:00.966232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.966721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.967159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:00.967987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:00.968557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:00.968984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.338747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:01.348364 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49add377-4fb5-42eb-80ef-3b9251be21ae tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1321 microversion: 2.1 time: 0.393000 Sep 22 12:30:01.349593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 51/111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:00 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:01.400858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4daa5ff1-0afd-480e-8b48-fb4b75af3583"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:01.403781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:01.411662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.412623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.413267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.414180 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.414635 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.415058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.540962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:01.541617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:01.547773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.548252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.548724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.549479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.549963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.550382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.686126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:01.695121 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e9604be-03b4-47fa-9f04-89f845abb8dc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1558 microversion: 2.1 time: 0.157883 Sep 22 12:30:01.696151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 52/112] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:01 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:01.702082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:01.703169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:01.711494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.712671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.713458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.714504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.715166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.715791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.899469 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:01.907784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8401f9d1-c7fa-4562-8418-db86847b3136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.210096 Sep 22 12:30:01.908657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 53/113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:01 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:01.913824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:01.914324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:01.920387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.920886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.921312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:01.922007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:01.922637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:01.923059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.108085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e77f7cf1-099e-4163-b53c-fb47e69c51db tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198167 Sep 22 12:30:02.109043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 54/114] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:30:01 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:02.296442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:02.353447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4b0a68bb-5ac2-41aa-a60b-2aaca7e47b43 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "POST /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956866 Sep 22 12:30:02.354970 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 61/115] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:30:01 2022] POST /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910/os-volume_attachments => generated 194 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:02.373515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:02.374328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:02.383595 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.386017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.386468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.390827 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.391368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.391824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.667063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:02.677252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48d019bd-2dc3-47d3-a9c0-f62ce36de36f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1516 microversion: 2.1 time: 0.307805 Sep 22 12:30:02.678036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 55/116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:02 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1516 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:02.709428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:02.714315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:02.732434 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.733457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.733912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.734782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.735236 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.735725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.763597 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'flavor' on Instance uuid 788e8c2c-8b83-46fe-8728-92c6b755c9c8 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:30:02.933462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:02.934694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:02.942118 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.951181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.951815 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:02.953942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:02.954362 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:02.954785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:03.057663 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9f01e8d0-4ca6-499e-95c6-e7277a496556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8/action" status: 200 len: 32 microversion: 2.1 time: 0.356665 Sep 22 12:30:03.060913 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 62/117] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:30:02 2022] POST /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:30:03.074494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:03.075371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:03.092581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:03.092581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:03.092581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:03.092581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:03.093113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:03.093113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:03.487256 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:03.496704 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4142dbfb-338c-4538-82ab-41c1d3b81e5e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.565952 Sep 22 12:30:03.498324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 56/118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:02 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:03.616246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:03.625998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7e8731a6-af35-4bc2-9492-2bad3cbdb384 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.559615 Sep 22 12:30:03.626590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 63/119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:03 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:04.255195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac05188-579c-4644-89f8-233e046b4618", "tag": "3ccdb191-e1dc-4383-95e0-0dda555c85b6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:04.268563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:04.269687 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:04.270202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:04.279935 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:04.282097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] Creating event network-changed:3ccdb191-e1dc-4383-95e0-0dda555c85b6 for instance 9ac05188-579c-4644-89f8-233e046b4618 on hv-cinder-85646 Sep 22 12:30:04.287553 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a6a74bc3-45bc-493a-aeb6-ba82b9e26a7f req-4ab449fc-b565-4cfd-bc6e-1c796aac6e8e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039918 Sep 22 12:30:04.288273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 57/120] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:30:04.521502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:04.522220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:04.539708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:04.544615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:04.547091 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:04.554777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:04.555657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:04.556860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:04.650802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:04.651506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:04.671989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:04.672585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:04.676237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:04.677034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:04.687472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:04.688089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:05.208307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:05.224398 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1ce3f156-70db-414b-b5e8-2d357ccce844 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.708710 Sep 22 12:30:05.224999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 64/121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:04 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:05.229013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:05.229885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ee64bd-305d-44e5-a1b7-00f4ef55cf64", "name": "network-vif-plugged", "status": "completed", "tag": "e2f4672c-6d5a-4ebe-b44f-8980103a38bf"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:05.239797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:05.240277 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:05.240892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:05.247850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8eb8adf2-092b-4a8c-8dda-d2c04d4bdd6d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.601209 Sep 22 12:30:05.248901 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 58/122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:04 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:05.252612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] Creating event network-vif-plugged:e2f4672c-6d5a-4ebe-b44f-8980103a38bf for instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 on hv-cinder-85646 Sep 22 12:30:05.260032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-c3a35f65-1a1b-4f25-a10d-aa3ae305727f req-33ad197e-fa8f-4793-91b8-a7a29f30d258 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Sep 22 12:30:05.260987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 65/123] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:06.249786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:06.250390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:06.257464 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:06.257942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:06.258371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:06.259054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:06.259498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:06.259912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:06.273252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:06.274762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:06.281970 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:06.282451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:06.282872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:06.283566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:06.284005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:06.285012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:06.474761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:06.480202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:06.486655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17e4eec9-8405-4f84-bbfc-81a80bff2953 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.241514 Sep 22 12:30:06.487435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 59/124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:06 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:06.488494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1311e86f-3f5d-4ca7-94e4-805f61e28364 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.220871 Sep 22 12:30:06.489074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 66/125] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:06 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:07.509080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:07.509812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:07.510576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:07.511187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:07.516321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:07.516795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:07.517231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:07.517691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:07.517917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:07.518178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:07.518360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:07.519122 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:07.519640 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:07.519809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:07.520253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:07.520695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:07.708284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:07.712187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:07.716033 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-135d6f1a-aaf2-41b9-8282-de3813865d9c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.210664 Sep 22 12:30:07.716823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 60/126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:07 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:07.720085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71bb0d3f-bcac-412f-8203-f9160d376e22 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.213243 Sep 22 12:30:07.720784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 67/127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:07 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:08.740283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:08.740924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:08.744591 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:08.745190 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:08.747232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:08.747716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:08.748158 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:08.748881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:08.749335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:08.749763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:08.750989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:08.751463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:08.751890 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:08.752604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:08.753046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:08.754753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:08.951055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:08.959340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:08.971292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4aa76a4c-e531-496f-8929-5e4c004d3201 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.235302 Sep 22 12:30:08.973718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a6e4a041-13e9-4d17-b2e4-89237399e1cc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.233119 Sep 22 12:30:08.985589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 68/128] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:08 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:08.985846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 61/129] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:08 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:09.998224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:09.998836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:10.001298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=84 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:10.007099 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:10.007588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:10.008029 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:10.008784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:10.009241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:10.009666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:10.010290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:10.010899 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:10.016932 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:10.017415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:10.017853 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:10.018570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:10.019022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:10.019576 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:10.209383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:10.212160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:10.218995 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c66e1526-ef00-4dc1-954b-51302b6e9625 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.224605 Sep 22 12:30:10.220341 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cf1e5cfa-28f5-41b7-8ba1-554adb2e6a73 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.213434 Sep 22 12:30:10.220579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 69/130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:09 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:10.220667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 62/131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:10 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:11.245699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:11.246988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:11.247532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:11.248152 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:11.254828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:11.255435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:11.255582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:11.256052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:11.256530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:11.256699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:11.257499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:11.257988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:11.258118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:11.258414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:11.258534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:11.259003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:11.459358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:11.462709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:11.467156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe49da27-fea3-4543-96de-d7e3425eb122 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.224185 Sep 22 12:30:11.467924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 63/132] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:11 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:11.470576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-45e6712a-88aa-4c5b-9d7c-76ec888cc5d2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.230618 Sep 22 12:30:11.471154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 70/133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:11 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:12.490403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:12.490966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:12.493017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=84 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:12.493590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:12.494199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:12.498398 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:12.498887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:12.499327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:12.500021 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:12.500511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:12.500932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:12.501039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:12.501414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:12.501845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:12.502528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:12.503479 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:12.503921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:12.688225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:12.692906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:12.696404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a14554b3-9ac6-4456-b623-3eabd16a7300 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.209951 Sep 22 12:30:12.696972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 64/134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:12 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:12.700978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-362a6f7e-f6c7-427a-995d-d6d1e0bc8370 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.211133 Sep 22 12:30:12.701644 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 71/135] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:12 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:13.719544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:13.720146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:13.724918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:13.725547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:13.727871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:13.728502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:13.728938 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:13.729628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:13.730074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:13.730495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:13.732286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:13.732850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:13.733313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:13.733990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:13.734437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:13.734853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:13.928221 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:13.931453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:13.936222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fa3102f6-aa29-4ca6-8486-72e7aa55999d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.220668 Sep 22 12:30:13.936855 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 65/136] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:13 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:13.939422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a0babf9e-69e4-4d82-b14f-98ba6f8d421f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.219067 Sep 22 12:30:13.940346 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 72/137] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:13 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:14.962300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:14.962911 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:14.963055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:14.963547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:14.970859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:14.971962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:14.972636 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:14.972884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:14.973378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:14.973811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:14.973969 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:14.974585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:14.975004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:14.976231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:14.977198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:14.977624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:15.367017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:15.379741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-588a9904-0c3c-439c-af48-8827a260cd9b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1363 microversion: 2.1 time: 0.424292 Sep 22 12:30:15.385251 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 66/138] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:14 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:15.433687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:15.442179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d1bc36e4-094e-4776-8b06-e9a6f73219a5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.482957 Sep 22 12:30:15.443202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 73/139] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:14 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:16.411104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:16.411777 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:16.420136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:16.420724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:16.421225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:16.423049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:16.423774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:16.424268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:16.466805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:16.468242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:16.487631 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:16.488955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:16.489570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:16.490736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:16.491334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:16.492114 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.187226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:17.205470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8fd3bd38-fc33-49ad-91af-c6e4d445550d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1550 microversion: 2.1 time: 0.799700 Sep 22 12:30:17.221944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 67/140] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:16 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1550 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:17.242724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:17.251199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:17.252090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:17.257288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-60ec306d-5a04-4c78-9657-af884d2d92d7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.794287 Sep 22 12:30:17.258065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 74/141] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:16 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:30:17.272903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.273713 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.274267 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.275401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.275848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.277305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.279161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:17.279843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:17.286673 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.287512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.288170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.289849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.290531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.291382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.310816 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:30:17.460836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4b17b3af-77ce-4898-b1b3-33cc1fb3c11e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186155 Sep 22 12:30:17.462406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 75/142] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:30:17 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:17.475885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dcfe1ee7-bb96-4a30-88c8-846f034513f8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 204 len: 0 microversion: 2.1 time: 0.242278 Sep 22 12:30:17.478207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 68/143] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:30:17 2022] DELETE /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:30:17.504322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:17.506523 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:17.527888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.528627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.529261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.530228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:17.530876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:17.531764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:17.996106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:18.006380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-65b8561a-3d09-45fb-bd78-c371daa3b204 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1555 microversion: 2.1 time: 0.522708 Sep 22 12:30:18.007207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 76/144] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:17 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1555 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:18.285584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:18.286281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:18.296085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:18.296606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:18.298448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:18.299178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:18.299620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:18.302281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:18.547336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:18.559771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11509c1f-5793-443d-82fd-853efd7d1d29 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.278371 Sep 22 12:30:18.561391 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 69/145] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:18 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:19.031570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:19.032888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:19.043720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:19.044576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:19.045571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:19.046630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:19.047285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:19.047945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:19.053893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:19.403585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ee64bd-305d-44e5-a1b7-00f4ef55cf64", "tag": "e2f4672c-6d5a-4ebe-b44f-8980103a38bf"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:19.421284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:19.423158 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:19.424043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:19.424523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:19.437844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-40c0d7ac-bd54-4973-adbb-ff1a60cdfc2b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1555 microversion: 2.1 time: 0.410358 Sep 22 12:30:19.443015 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 77/146] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:19 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1555 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:19.446762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] Creating event network-changed:e2f4672c-6d5a-4ebe-b44f-8980103a38bf for instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 on hv-cinder-85646 Sep 22 12:30:19.455175 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b77e2f8c-0d9e-4304-853e-ea0fb495306e req-9f393fde-bd87-4d6e-915d-cc22334dfb09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055015 Sep 22 12:30:19.456082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 70/147] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:30:19.584405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:19.585846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:19.600892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:19.601642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:19.604554 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:19.607094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:19.609573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:19.610232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:19.876862 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:19.886004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ee758d95-cf2f-49db-ae63-4b3f295be13b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.306984 Sep 22 12:30:19.888619 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 78/148] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:19 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:20.473276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:20.473987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:20.488436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:20.488972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:20.489412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:20.490123 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:20.490573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:20.490999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:20.853099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:20.863507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dcf7b333-a438-468b-b177-9bace7ca059b tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1555 microversion: 2.1 time: 0.396278 Sep 22 12:30:20.864497 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 71/149] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:20 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1555 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:20.910796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:20.912893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:20.926641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:20.927571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:20.928282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:20.929304 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:20.941768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:20.942775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:21.284647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:21.301587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7132a061-774c-4ec1-9392-4186cc70d9d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.394719 Sep 22 12:30:21.302387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 79/150] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:20 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:21.361318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e388d2-8f9f-483b-8b65-1abf586e7910", "name": "network-vif-deleted", "tag": "63348aca-86db-4bd1-aed7-9cad6b48e679"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:21.385667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:21.386655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:21.387331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:21.409482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] Creating event network-vif-deleted:63348aca-86db-4bd1-aed7-9cad6b48e679 for instance f7e388d2-8f9f-483b-8b65-1abf586e7910 on hv-cinder-85646 Sep 22 12:30:21.420197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-264ee082-39c1-40b7-a2bb-68403d0774f2 req-e013808e-189c-4926-8745-8622aabd002f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066558 Sep 22 12:30:21.424284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 72/151] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:21.888520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:21.889226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:21.895908 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:21.898123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:21.902859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:21.903601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:21.904152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:21.904772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:21.940877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:21.943242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:21.943679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:21.944279 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lazy-loading 'fault' on Instance uuid f7e388d2-8f9f-483b-8b65-1abf586e7910 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:30:22.004845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e125a85011fe402ab2d5782d8fd39dfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfd00e7112b409bba3cdf9480508b02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:22.014600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d4f9051a-ca71-493a-b633-70d05c1e0d79 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 200 len: 1351 microversion: 2.1 time: 0.129823 Sep 22 12:30:22.015731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 80/152] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:21 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 1351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:22.330230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:22.331260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:22.338799 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:22.339485 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:22.339992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:22.340978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:22.341537 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:22.342060 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:22.536688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:22.544615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-92f42149-43e1-4ca8-98fc-d9e981c4ee61 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.219238 Sep 22 12:30:22.545197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 73/153] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:22 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:23.040166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:23.040810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:23.048000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.048584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.049028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.049762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.050354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.051362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.069739 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] HTTP exception thrown: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Request method failure captured: Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 HTTP/1.1 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUUbSK-XOQv0Fr1fBqOhAv4iaJWHGPf1WYShdq-tZKSfEuV2Cy4aQ12otVSr2kNb-0Lt_HYW7_TWI767uLQLVsv2IrEzJ1YLgHYdrJ063G38pFPcaTAcL-Dw0fibICRIqtXl-5d9-K2S7TxIE_UhrN6O0-1wCZ1hs42ZzPf9WzDcmg Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:30:23.074810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_acfd00e7112b409bba3cdf9480508b02"}]}] Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: e125a85011fe402ab2d5782d8fd39dfc Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.076094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f7e388d2-8f9f-483b-8b65-1abf586e7910'} Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:30:23.076805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.078007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.079112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Returning 404 to user: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:30:23.079112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a8231b00-a5ad-44f9-a43c-b9ce6f50cdab tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 404 len: 111 microversion: 2.1 time: 0.040368 Sep 22 12:30:23.079112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 81/154] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:23 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:30:23.197673 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:23.200015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:23.205944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.206412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.206843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.207529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.207970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.208408 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.212113 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:23.221851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] HTTP exception thrown: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Request method failure captured: Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910/os-volume_attachments HTTP/1.1 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUUbSK-XOQv0Fr1fBqOhAv4iaJWHGPf1WYShdq-tZKSfEuV2Cy4aQ12otVSr2kNb-0Lt_HYW7_TWI767uLQLVsv2IrEzJ1YLgHYdrJ063G38pFPcaTAcL-Dw0fibICRIqtXl-5d9-K2S7TxIE_UhrN6O0-1wCZ1hs42ZzPf9WzDcmg Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:30:23.226742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_acfd00e7112b409bba3cdf9480508b02"}]}] Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: e125a85011fe402ab2d5782d8fd39dfc Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.228412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'server_id': 'f7e388d2-8f9f-483b-8b65-1abf586e7910'} Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:30:23.229132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:23.230151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:23.231830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Returning 404 to user: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:30:23.231830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12c498ff-41bf-4068-8391-be907d7df292 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036233 Sep 22 12:30:23.231830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 74/155] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:30:23 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:30:23.568235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:23.569232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:23.575578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.576062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.576570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.577506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:23.577768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:23.578194 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:23.722425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:23.730462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-db6342b2-bda5-4712-a5d0-1a7467fcd51d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.166281 Sep 22 12:30:23.731020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 82/156] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:23 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:24.453517 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:24.454584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:24.474324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.474987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.475576 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.476757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.477479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.477909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.493896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] HTTP exception thrown: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Request method failure captured: Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 HTTP/1.1 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUUbSK-XOQv0Fr1fBqOhAv4iaJWHGPf1WYShdq-tZKSfEuV2Cy4aQ12otVSr2kNb-0Lt_HYW7_TWI767uLQLVsv2IrEzJ1YLgHYdrJ063G38pFPcaTAcL-Dw0fibICRIqtXl-5d9-K2S7TxIE_UhrN6O0-1wCZ1hs42ZzPf9WzDcmg Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:30:24.496380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_acfd00e7112b409bba3cdf9480508b02"}]}] Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: e125a85011fe402ab2d5782d8fd39dfc Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.497986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'f7e388d2-8f9f-483b-8b65-1abf586e7910'} Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:30:24.498684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.500242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.502355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Returning 404 to user: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:30:24.502355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a9e8490-e96d-4cf3-b29d-c18b361b976a tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 404 len: 111 microversion: 2.1 time: 0.050410 Sep 22 12:30:24.502355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 75/157] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:30:24 2022] DELETE /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:30:24.507557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:24.508171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] [instance: f7e388d2-8f9f-483b-8b65-1abf586e7910] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:24.514589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.515065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.515495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.516172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.516651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.517066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.530242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] HTTP exception thrown: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Request method failure captured: Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 HTTP/1.1 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUUbSK-XOQv0Fr1fBqOhAv4iaJWHGPf1WYShdq-tZKSfEuV2Cy4aQ12otVSr2kNb-0Lt_HYW7_TWI767uLQLVsv2IrEzJ1YLgHYdrJ063G38pFPcaTAcL-Dw0fibICRIqtXl-5d9-K2S7TxIE_UhrN6O0-1wCZ1hs42ZzPf9WzDcmg Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:30:24.531725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/acfd00e7112b409bba3cdf9480508b02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_acfd00e7112b409bba3cdf9480508b02"}]}] Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: acfd00e7112b409bba3cdf9480508b02 Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-DeleteServersTestJSON-370625270 Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: e125a85011fe402ab2d5782d8fd39dfc Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-DeleteServersTestJSON-370625270-project Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.533139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f7e388d2-8f9f-483b-8b65-1abf586e7910'} Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:30:24.533854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. Sep 22 12:30:24.535455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:30:24.536429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] Returning 404 to user: Instance f7e388d2-8f9f-483b-8b65-1abf586e7910 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:30:24.536429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0156b0ee-eb6c-41af-b114-ace725584af8 tempest-DeleteServersTestJSON-370625270 tempest-DeleteServersTestJSON-370625270-project] 10.222.0.33 "GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910" status: 404 len: 111 microversion: 2.1 time: 0.029713 Sep 22 12:30:24.536429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 83/158] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:24 2022] GET /compute/v2.1/servers/f7e388d2-8f9f-483b-8b65-1abf586e7910 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:30:24.754157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:24.754670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:24.760789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.761268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.761700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.762384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:24.762823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:24.763240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:24.903998 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:24.912384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97bf0f09-45c3-4ebf-a78e-1600d315c51f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.162352 Sep 22 12:30:24.912958 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 76/159] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:24 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:25.936165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:25.937502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:25.945600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:25.946092 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:25.946526 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:25.947638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:25.948497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:25.949374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:26.409447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:26.421895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9cc1dfd9-a0a3-4352-bfd0-82192baf5437 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.490563 Sep 22 12:30:26.422819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 84/160] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:25 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:27.444568 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:27.445617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:27.453598 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:27.454299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:27.455162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:27.456597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:27.457423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:27.457893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:27.747995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:27.764887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6751fcf-5f3f-4a0e-8daa-58620d59f33d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.324092 Sep 22 12:30:27.765781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 77/161] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:27 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:28.792701 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:28.793407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:28.807259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:28.807935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:28.809699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:28.812355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:28.812966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:28.813404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:29.091557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:29.101428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b4e59200-400b-4c66-839d-13941b60462f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.313166 Sep 22 12:30:29.102351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 85/162] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:28 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:30.145458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:30.146607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:30.157419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:30.157914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:30.158347 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:30.159050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:30.159545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:30.166992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:30.363946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:30.377249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60106254-6946-4d2d-a13e-a34e8f09e8b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.254861 Sep 22 12:30:30.379774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 78/163] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:30 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:31.403120 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:31.403878 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:31.412671 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:31.413614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:31.417383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:31.418243 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:31.418836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:31.419376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:31.592622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:31.602296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ccee5bce-c470-44bc-a27b-a92bce5cccca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.202818 Sep 22 12:30:31.603250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 86/164] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:31 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:32.632798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:32.633402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:32.640839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:32.641549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:32.642303 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:32.643156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:32.644068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:32.644826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:32.882244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:32.891102 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3ea82263-8305-4b0d-b867-0cc7e775653e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.262036 Sep 22 12:30:32.891950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 79/165] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:32 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:33.914438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:33.917449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:33.924742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:33.925723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:33.926331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:33.927214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:33.927815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:33.928418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:34.749879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:34.799494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2d6f66a9-78f0-4a37-a389-3f75126acf6f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.888738 Sep 22 12:30:34.817163 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 87/166] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:33 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:35.832352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:35.833543 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:35.844787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:35.845426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:35.845874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:35.849475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:35.850374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:35.853587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:36.132044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-903e7bcb-8c6c-4cc5-af9e-29332c26008a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: .version_select at 0x7f1079f838b0>, body: {"keypair": {"name": "tempest-keypair-1728861724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/8R3AzkLUsZEVKRUZDA/fSpmd1xvBv+BLDnU+2XhThRltyLJAzhMpyJzkfk/1gLz/cPcudl5gnz45/fbuA7RdsDLPckEhePj1Nev1lTHvEiQKq3P3JrK/8x+lTLFxRsA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:36.138645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:36.150936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-aee7adb3-fff4-46db-a35c-fdb401d5c7dd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.325299 Sep 22 12:30:36.155646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 88/167] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:35 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:36.165269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-903e7bcb-8c6c-4cc5-af9e-29332c26008a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for project 553395befb8f4c958d34b7dffb2317e7. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:30:36.175501 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-903e7bcb-8c6c-4cc5-af9e-29332c26008a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for user 262e5327ba144a6287fef6dd6293f886 and project 553395befb8f4c958d34b7dffb2317e7. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:30:36.221440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-903e7bcb-8c6c-4cc5-af9e-29332c26008a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.596038 Sep 22 12:30:36.223342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 80/168] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Sep 22 12:30:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 598 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 22 12:30:37.179532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:37.180143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:37.202266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:37.210438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:37.214375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:37.217925 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:37.218622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:37.220059 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:37.617562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:37.631235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-98849232-5c57-49f6-9da0-ff8ef4db7e0e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.458468 Sep 22 12:30:37.636610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 89/169] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:37 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:38.655719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:38.668442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:38.697711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:38.705018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:38.705241 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:38.705946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:38.706440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:38.706868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:38.885631 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1041727071", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08232c3f-2666-43a1-afb2-c887234ff0ea"}], "security_groups": [{"name": "tempest-securitygroup--377710424"}], "key_name": "tempest-keypair-1728861724", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:38.953555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:38.961867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f0ebdbf-7fc1-4c71-98ef-6def3f02c8c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.310405 Sep 22 12:30:38.962467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 81/170] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:38 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:39.087391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] validate_networks() for [('08232c3f-2666-43a1-afb2-c887234ff0ea', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:30:39.859792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:30:39.860532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:30:39.861139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:30:39.863646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:30:39.864169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:30:39.876628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:39.877225 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:39.877949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:39.879539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:39.881021 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:39.881680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:39.921736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for project 553395befb8f4c958d34b7dffb2317e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:30:39.927324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for user 262e5327ba144a6287fef6dd6293f886 and project 553395befb8f4c958d34b7dffb2317e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:30:39.951397 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:30:39.954087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:30:39.990410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:39.991660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:40.017547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:40.018049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:40.018484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:40.039026 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4ccd0bda-3dd4-4c33-badc-3da48e391928 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.158180 Sep 22 12:30:40.044689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:40.045286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:40.045737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:40.054186 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 90/171] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Sep 22 12:30:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 22 12:30:40.062748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:40.064279 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:40.084633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:40.247872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:40.271481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:40.275891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:40.281475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f6fac81-c6f6-485f-b7fc-04206e9de45b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1282 microversion: 2.20 time: 0.225502 Sep 22 12:30:40.283328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 91/172] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:40 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:40.444697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:40.461857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8cd294d9-5ffd-446a-9b6f-5792e35307be tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.475769 Sep 22 12:30:40.463095 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 82/173] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:39 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:41.311048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:41.311750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:41.326907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:41.327415 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:41.327850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:41.328936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:41.329422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:41.329849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:41.408862 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:41.419696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:41.421407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:41.422531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4b729796-881f-4e45-9a87-8112c5842e89 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1286 microversion: 2.20 time: 0.115530 Sep 22 12:30:41.423084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 92/174] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:41 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:41.492186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:41.492752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:41.513585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:41.514305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:41.514756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:41.515476 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:41.516071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:41.517164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:41.763197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:41.773120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-843e7d03-812a-4369-9fb7-a36855cc69a2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1522 microversion: 2.1 time: 0.287796 Sep 22 12:30:41.773782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 83/175] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:41 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:42.451038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:42.451603 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:42.465918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:42.474067 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:42.476513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:42.477732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:42.479089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:42.480626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:42.591724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:42.604100 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:42.608028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:42.610669 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-26895e3d-f41a-4fc7-ba9d-7347b7d6c438 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1342 microversion: 2.20 time: 0.164684 Sep 22 12:30:42.612413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 93/176] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:42 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:42.796898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:42.798625 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:42.800587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:42.814345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:42.815519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:42.817751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:42.818669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:42.820714 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:42.821154 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:43.030760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:43.043125 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-512d158f-6bce-4d46-bf2c-3e04b9a3e713 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1502 microversion: 2.1 time: 0.250916 Sep 22 12:30:43.044605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 84/177] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:42 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:43.068871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:43.070075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:43.078016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:43.079329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:43.079871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:43.080679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:43.081822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:43.082261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:43.329078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:43.346617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8f3384c2-ed80-4793-ab2a-9d5ba418b2de tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1515 microversion: 2.1 time: 0.281525 Sep 22 12:30:43.348354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 94/178] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:43 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:43.640948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:43.641759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:43.655416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:43.656200 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:43.657018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:43.659208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:43.660684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:43.661592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:43.821191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:43.838019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:43.841447 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:43.842835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b6465f7-6cd1-4399-afe0-13262ecf79f7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1340 microversion: 2.20 time: 0.206066 Sep 22 12:30:43.857147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 85/179] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:43 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1340 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:44.873810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:44.874420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:44.884121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:44.884973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:44.887074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:44.888660 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:44.893233 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:44.894272 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:45.058403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:45.072867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:45.074298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:45.075392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-36cab2f0-f03b-48c6-8f93-7b5e2d1cac7c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.205522 Sep 22 12:30:45.075943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 95/180] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:44 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:46.098134 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:46.101128 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:46.101253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:46.102694 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:46.108810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.109716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.110437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.111406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.112004 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.112524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.112806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.113497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.114269 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.115834 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.116662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.117902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.136442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:46.146163 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'flavor' on Instance uuid e0f8b6d4-4a92-4a94-a7d2-23435c651c4d {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:30:46.202570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:46.348424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b9be19a8-4ec7-44af-bc69-662a35083bd3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/action" status: 200 len: 32 microversion: 2.1 time: 0.256174 Sep 22 12:30:46.348578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 86/181] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:30:46 2022] POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 12:30:46.357635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:46.366364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:46.391276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:46.396466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:46.398887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c1d0598b-3fc4-4b8f-bc82-00f4b8b5831f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.302354 Sep 22 12:30:46.399804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.400366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 96/182] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:46 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:30:46.400513 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.401337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.407570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:46.408499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:46.419331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.420477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.421153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.422196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:46.422951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:46.423522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:46.436780 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] Creating event network-changed:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:30:46.450008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-475663a5-4562-4a21-9d67-3b5757b6fad7 req-068ec833-ac53-46be-b8f6-d354dd918e93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099735 Sep 22 12:30:46.453928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 87/183] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:30:46.770205 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:46.780812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-482067d1-1312-4da0-934b-66b5ca2ffd4c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.378509 Sep 22 12:30:46.781398 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 97/184] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:46 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:47.424484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:47.425177 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:47.431231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:47.431717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:47.432148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:47.432864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:47.433313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:47.433734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:47.562245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:47.570299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:47.571725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:47.572847 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8bad3f7-fdc6-467f-98e7-572a9df51ea0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.152633 Sep 22 12:30:47.573404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 88/185] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:47 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:47.804305 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:47.804941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:47.811396 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:47.811825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:47.812263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:47.813084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:47.813536 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:47.813962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:47.943716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:47.951386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dbad4701-3e38-489a-84b0-844edc70a57b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.150915 Sep 22 12:30:47.951945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 98/186] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:47 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:48.598365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:48.598967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:48.605155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:48.605636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:48.606092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:48.606749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:48.607198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:48.607617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:48.733695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:48.744342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:48.745889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:48.747006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3826eb45-515b-4fa5-bb11-eb8e9b295a7e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.153022 Sep 22 12:30:48.747563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 89/187] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:48 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:48.975557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:48.976165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:48.982873 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:48.983345 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:48.983781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:48.984503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:48.984984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:48.985406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:49.112239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:49.119980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0412d2ba-6790-4686-8cc8-e328214f4fac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.148895 Sep 22 12:30:49.120575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 99/188] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:48 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:49.772632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:49.773255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:49.779232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:49.779710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:49.780143 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:49.780861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:49.781305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:49.781724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:49.907392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:49.915845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:49.917290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:49.918376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63c31f97-7977-4b5c-a7fb-48651764609a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.149709 Sep 22 12:30:49.918927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 90/189] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:49 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:50.143170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:50.143854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:50.145709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:50.151569 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:50.152044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:50.152501 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:50.153186 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:50.153626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:50.154044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:50.255509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=8 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:50.287453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:50.295031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cb8eca16-dab0-403a-8ccf-8903bc6c5828 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.155674 Sep 22 12:30:50.295604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 100/190] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:50 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:50.943329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:50.943934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:50.949921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:50.950399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:50.950836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:50.951512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:50.951964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:50.952426 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:51.076946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:51.079201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:30:51.086547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:51.087982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:51.089101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73fea3f0-57fb-43f4-94c8-714c81ac1c43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.150108 Sep 22 12:30:51.089655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 91/191] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:50 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:51.318406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:51.318992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:51.325382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:51.325894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:51.326327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:51.327008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:51.327455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:51.327870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:51.456084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:51.463873 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-895170dc-8733-477b-8463-ac97c13faab4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.149985 Sep 22 12:30:51.464462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 101/192] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:51 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:52.113864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:52.114467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:52.121785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:52.122308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:52.122736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:52.123409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:52.123851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:52.124264 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:52.254235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:52.262195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:52.263616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:52.264731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8d17a83-70a7-408d-80fa-2147c5b26f72 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.154683 Sep 22 12:30:52.265290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 92/193] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:52 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:52.486961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:52.488092 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:52.494598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:52.495073 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:52.495502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:52.496173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:52.496642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:52.497057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:52.621542 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:52.629759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-45ce1360-3f99-49c7-af4a-70ea14fe215b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.146698 Sep 22 12:30:52.630315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 102/194] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:52 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:53.289778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:53.290313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:53.296170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:53.296672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:53.297093 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:53.297762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:53.298203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:53.298615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:53.461697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:53.469825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:53.471242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:53.472956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c50a815d-293f-4286-b567-8e1a73135e59 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.187123 Sep 22 12:30:53.473511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 93/195] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:53 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:53.652334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:53.652953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:53.659655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:53.660146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:53.660616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:53.661325 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:53.661900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:53.662332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:54.029450 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:54.037164 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9af208db-cc31-4b03-94b5-a6b9bfddbb03 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.388725 Sep 22 12:30:54.037733 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 103/196] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:53 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:54.497807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:54.498406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:54.504876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:54.505349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:54.505774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:54.506447 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:54.506887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:54.507299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:54.638380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:54.647064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:54.648534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:54.649625 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6a1c669-8eca-4c1b-9a45-0264f26b672d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.155649 Sep 22 12:30:54.650187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 94/197] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:54 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:30:55.059760 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:55.060415 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:55.067487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:55.067971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:55.068445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:55.069137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:55.069590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:55.070014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:55.194046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:55.201769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f8b508d0-b057-4c01-90c3-9143a8e20ec2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.145907 Sep 22 12:30:55.202363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 104/198] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:55 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:55.678312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:55.678913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:55.684774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:55.685247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:55.685670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:55.686343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:55.686785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:55.687203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:55.816533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:55.824548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:55.825965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:55.827050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b481528d-2bfd-423b-bc5e-35c0e7a2d8b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.152520 Sep 22 12:30:55.827597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 95/199] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:55 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:56.224652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:56.225276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:56.232182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:56.232685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:56.233113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:56.233787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:56.234228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:56.234641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:56.362982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:56.370821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-660dcbc2-4535-4619-acea-3a5be82de11b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.150099 Sep 22 12:30:56.371383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 105/200] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:56 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:56.851400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:56.852445 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:56.859547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:56.860142 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:56.860769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:56.861581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:56.862606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:56.863166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:56.993056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:57.001152 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:57.002585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:57.003676 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e35d251-5386-41a3-9870-5525212c71c2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.156163 Sep 22 12:30:57.004233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 96/201] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:56 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:57.394636 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:57.395238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:57.402241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:57.402793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:57.403286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:57.404109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:57.405035 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:57.405035 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:57.536693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:57.544464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-96b1dd8e-231f-440f-a784-a6b19612e413 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.154347 Sep 22 12:30:57.545020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 106/202] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:57 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:58.028719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:58.030450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:58.036526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:58.037115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:58.037682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:58.038248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:58.038751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:58.039178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:58.171186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:58.180319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:58.181845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:58.182938 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c17b1a83-fc54-49e0-ade6-527a78113f2e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.158754 Sep 22 12:30:58.183491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 97/203] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:58 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:58.568282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:58.569382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:58.576221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:58.576749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:58.577179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:58.577866 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:58.578319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:58.578775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:58.855910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:58.864222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ebe9f5b9-dea2-47fb-a122-c0a710bd2658 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.300653 Sep 22 12:30:58.873530 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 107/204] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:58 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:30:59.207703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:59.208495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:59.214692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:59.215185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:59.215621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:59.216334 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:59.216952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:59.217381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:59.353766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:59.362491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:59.363941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:30:59.365076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-051f80ed-569a-4a92-b8c0-198af8a5fda7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.162076 Sep 22 12:30:59.365694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 98/205] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:30:59 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:30:59.863408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "name": "network-vif-plugged", "status": "completed", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:30:59.894645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:30:59.895272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:30:59.895724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:59.896473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:59.897058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:59.907614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:59.908215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:59.912630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:59.913386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:30:59.914203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:30:59.914853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] Creating event network-vif-plugged:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:30:59.915000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:30:59.932761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-f8decabd-2195-48ee-9e9e-d92dbcf4774d req-2a1dc0d7-d28c-44e8-a54b-5833f34ded7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074793 Sep 22 12:30:59.933683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 108/206] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:00.078080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:00.086271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6006d9d-2755-4e49-b441-b35319ea1379 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.202967 Sep 22 12:31:00.088338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 99/207] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:30:59 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:00.392812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:00.393888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:00.400157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:00.400677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:00.401106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:00.401794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:00.402241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:00.402658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:00.544978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:00.555551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:00.557591 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:00.559199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-422df8fc-c2be-4f0b-9d41-7759536f748a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.170913 Sep 22 12:31:00.560055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 109/208] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:00 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:01.113061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:01.113770 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:01.119854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:01.120361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:01.120796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:01.121484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:01.121940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:01.122359 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:01.254649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:01.262602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a5582d37-03da-48dd-8304-44fb74b947e2 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.153918 Sep 22 12:31:01.263161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 100/209] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:01 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:01.585453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:01.586055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:01.591956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:01.592485 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:01.592918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:01.593601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:01.594052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:01.594476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:01.733982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:01.742242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:01.743766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:01.745307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6a38b8c3-6656-47b9-bdfa-43f3c6467a85 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.164390 Sep 22 12:31:01.760906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 110/210] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:01 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:02.285415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:02.285939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:02.291802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:02.292278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:02.292731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:02.293404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:02.293845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:02.294269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:02.421372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:02.429791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b0884ff8-07fc-4f6b-9953-98380b1af634 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.148276 Sep 22 12:31:02.430343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 101/211] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:02 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:02.771233 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:02.771837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:02.778307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:02.778786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:02.779219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:02.779902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:02.780382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:02.780806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:02.908275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:02.917126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:02.918559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:02.919651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4cacca4f-48dd-4293-9de6-238bd9cd0d62 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.152366 Sep 22 12:31:02.920193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 111/212] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:02 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:03.452516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:03.453117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:03.459970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:03.460578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:03.461009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:03.461682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:03.462127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:03.462541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:03.590282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:03.598441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-150efb0d-3f98-4a3b-9224-806f80615f05 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.149820 Sep 22 12:31:03.599000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 102/213] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:03 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:03.950858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:03.950858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:03.953271 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:03.953757 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:03.954203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:03.954897 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:03.955355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:03.955775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:04.106942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:04.117602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:04.119052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:04.120191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c1c4c127-1bcb-4787-98c1-07621c51639f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.178720 Sep 22 12:31:04.120972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 112/214] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:03 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:04.622011 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:04.622550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:04.628746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:04.629229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:04.629662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:04.630346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:04.630795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:04.631215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:04.759488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:04.767295 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d6f38221-1f42-48b8-81f5-a473130d3d76 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.149216 Sep 22 12:31:04.767862 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 103/215] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:04 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:05.145388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:05.145949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:05.152367 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:05.152853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:05.153289 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:05.153978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:05.154437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:05.154862 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:05.282530 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:05.284872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:05.291949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:05.293419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:05.294503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-475fd718-8181-4b6d-a1a5-ae6f3c097724 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.153811 Sep 22 12:31:05.295045 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 113/216] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:05 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:05.791889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:05.792523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:05.798714 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:05.799767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:05.800403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:05.801092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:05.801534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:05.801949 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:05.927310 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:05.935053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-544c84ae-3246-4270-bbf2-95e89bc5a500 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.148184 Sep 22 12:31:05.935607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 104/217] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:05 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:06.318787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:06.319395 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:06.325883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:06.326373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:06.326809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:06.327494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:06.327948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:06.328399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:06.455322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:06.463997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:06.465475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:06.466573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b48a37bd-de33-4408-a0d9-29f7bd782a24 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.151678 Sep 22 12:31:06.467122 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 114/218] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:06 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:06.957755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:06.958547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:06.964625 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:06.965110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:06.965543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:06.966231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:06.966685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:06.967112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:07.093477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:07.103688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c36ec4c-fce9-4a1b-8445-bf0920ebf91d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.149807 Sep 22 12:31:07.104260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 105/219] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:06 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:07.495079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:07.495686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:07.501986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:07.502469 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:07.502906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:07.503630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:07.504090 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:07.504541 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:07.641601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:07.650228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:07.651668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:07.652803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-da7148a0-3ed3-4b7b-8489-6deed9488eaa tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.161685 Sep 22 12:31:07.653358 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 115/220] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:07 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:08.127718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:08.128909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:08.134832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:08.135311 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:08.135743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:08.136455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:08.136928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:08.137325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:08.277250 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:08.285751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6fb23903-bc26-441a-b964-c6c3562d1924 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.161735 Sep 22 12:31:08.286499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 106/221] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:08 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:08.678384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:08.679086 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:08.685684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:08.686192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:08.686618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:08.687306 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:08.687755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:08.688173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:08.821249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:08.829213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:08.830662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:08.831804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f751f97-f895-4ad6-bdea-277566d6ca9e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.157917 Sep 22 12:31:08.832380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 116/222] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:08 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:31:09.309143 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:09.309864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:09.316381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:09.316793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:09.317218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:09.317905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:09.318349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:09.318763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:09.463912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:09.472721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b8b960d-eaef-4313-bda7-d338ca58fc10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.167421 Sep 22 12:31:09.473316 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 107/223] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:09 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:09.856947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:09.857580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:09.864993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:09.865487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:09.865922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:09.866625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:09.867106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:09.867533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:10.002628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:10.012766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:10.014224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:10.015337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3287bdf0-c501-42b2-82ad-50458d469feb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1407 microversion: 2.20 time: 0.162366 Sep 22 12:31:10.015886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 117/224] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:09 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:10.502288 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:10.503168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:10.511237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:10.512138 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:10.512822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:10.513732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:10.514379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:10.515310 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:10.550832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:10.681531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:10.689963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5087a59-b24e-4ec6-bed1-cf87c8283f5e tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.192978 Sep 22 12:31:10.690657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 108/225] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:10 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:11.039022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:11.039630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:11.042270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=56 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:11.047818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.048331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.048789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:11.049476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.049969 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.050435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:11.263080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:11.271535 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:11.273022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:11.274189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b4783aef-51b5-407a-8a69-5b3b458bda8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1599 microversion: 2.20 time: 0.239105 Sep 22 12:31:11.274745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 118/226] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:11 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:11.298675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:11.299098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:11.305591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.306058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.306490 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:11.307183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.307632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.308057 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:11.395526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18a29d01-e263-4b28-8afa-fd35ed162c33 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100701 Sep 22 12:31:11.396322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 109/227] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Sep 22 12:31:11 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:31:11.714571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:11.715193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:11.729711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.730210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.730907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:11.731836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:11.732318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:11.732742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:12.040937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:12.056744 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-440ba2f8-4f3b-4d25-85e8-dd9ada72dc4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.347393 Sep 22 12:31:12.058187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 119/228] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:11 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:12.723555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:12.735652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:12.735652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:12.735652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:12.748132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] Creating event network-changed:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:31:12.754285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f7e8a5bf-80b1-41b0-b816-374e90a8c262 req-42931224-318a-489e-9f42-54fda50bda35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Sep 22 12:31:12.755153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 110/229] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:13.082175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:13.082809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:13.093350 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:13.094206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:13.095052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:13.096086 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:13.097758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:13.098459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:13.336437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:13.344254 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d38c658e-2b4b-4c60-b200-7ad4dd9d3b9c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.266530 Sep 22 12:31:13.345098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 120/230] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:13 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:14.368621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:14.369352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:14.371259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=54 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:14.376871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:14.377354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:14.377792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:14.378477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:14.378937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:14.379362 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:14.504856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:14.512486 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6f5e531-a804-427f-b5b0-679a6baace10 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.148073 Sep 22 12:31:14.513050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 111/231] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:14 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:15.535357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:15.535955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:15.542314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:15.542784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:15.543215 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:15.543992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:15.544464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:15.544879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:15.670360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:15.678506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-81ec435e-30c5-46d7-acaa-136dc4136261 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.147489 Sep 22 12:31:15.679057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 121/232] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:15 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:16.701122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:16.701707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:16.707585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:16.708063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:16.708531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:16.709220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:16.709665 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:16.710087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:16.846531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:16.855002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d1b129a0-dd62-4740-a409-e63353a16ebf tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.157683 Sep 22 12:31:16.855565 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 112/233] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:16 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:17.878955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:17.879562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:17.886623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:17.887013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:17.887585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:17.888278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:17.888810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:17.889223 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:18.042759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:18.051246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a6ea5dd4-9902-4230-aa22-239a56922b1c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.176653 Sep 22 12:31:18.051899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 122/234] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:17 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:19.075553 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:19.076871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:19.089198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.096212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.098946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.100541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.101381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.101832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.277647 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:19.285410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-393c21e4-b687-4c68-80a5-1dd61aba4556 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1501 microversion: 2.1 time: 0.213805 Sep 22 12:31:19.286054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 113/235] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:19 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:19.307411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1abc57d-ead0-49da-89b9-df7c4ffff432"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:19.309745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:19.316573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.317057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.317488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.318178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.318630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.319046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.342808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] HTTP exception thrown: Cannot 'attach_volume' instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d while it is in vm_state rescued Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Request method failure captured: Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/os-volume_attachments HTTP/1.1 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 74 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUcj0K8tQrrX6-a54Yi10L4gYKD9mDkoaz30c9nagl9Z3VctGf0yaEEIAZIGHsEfToadDMBXHS0GmzzOm0aPxHFOxjdvgVHNLxM0WAO7Yb-ylj_f0MZhSnDRojLpuizq7LVpG7hXZAxfVHN02J9sVXnuwRZ4826fjZLv1h0rqZDX4I Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:31:19.345057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb62ca26c4fe47deb0a21511a96e6403"}]}] Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 0847f00afbde44068fcf1cedbce24be5 Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {"volumeAttachment": {"volumeId": "d1abc57d-ead0-49da-89b9-df7c4ffff432"}} Sep 22 12:31:19.346546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Cannot 'attach_volume' instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d while it is in vm_state rescued Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'server_id': 'e0f8b6d4-4a92-4a94-a7d2-23435c651c4d', 'body': {'volumeAttachment': {'volumeId': 'd1abc57d-ead0-49da-89b9-df7c4ffff432'}}} Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:31:19.347803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d while it is in vm_state rescued Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:19.348993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d while it is in vm_state rescued Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Returning 409 to user: Cannot 'attach_volume' instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d while it is in vm_state rescued {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e0196c38-b78d-4c52-8c1d-50243c9410fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043059 Sep 22 12:31:19.352889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 123/236] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:31:19 2022] POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 22 12:31:19.355891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:19.356361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:19.362267 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.362961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.363392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.364242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.364865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.365443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.434127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1855dc5b-c22b-4125-af04-48914b152bce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/action" status: 202 len: 0 microversion: 2.1 time: 0.082041 Sep 22 12:31:19.434940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 114/237] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:31:19 2022] POST /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:31:19.448013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:19.448746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:19.455650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.456820 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.457455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.458152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:19.458599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:19.459044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:19.604420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:19.614981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-daabe04a-962d-465b-93f3-90dd523331e4 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1509 microversion: 2.1 time: 0.175759 Sep 22 12:31:19.615618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 124/238] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:19 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:20.286575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-204598928", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:20.303426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:20.303920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:20.312211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.312717 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.313046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.313722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.314196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.314587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.344722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f67df69a-c5d1-4c88-92f3-70980d10ccd8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/ips" status: 200 len: 150 microversion: 2.1 time: 0.044934 Sep 22 12:31:20.345409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 125/239] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:31:20 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:31:20.357222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] validate_networks() for None {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:20.640672 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:20.641497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:20.650849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.651201 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.652402 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.653341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.653964 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.655039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.721953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:20.722460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:20.723465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:20.724023 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:20.724546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:20.743125 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.744496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.746423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.748415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:20.748898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:20.754593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:20.774947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Getting quotas for project 64ab512913704ae1b116cd0c3189760b. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:20.779606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Getting quotas for user 0f090f1b5d1449fca5f077b6f6a9be1f and project 64ab512913704ae1b116cd0c3189760b. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:20.792583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:20.795567 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:20.828528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:20.838692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e733f665-a18d-457b-ab3f-0f4ba685d285 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1509 microversion: 2.1 time: 0.203363 Sep 22 12:31:20.839924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 126/240] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:20 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:20.856052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c28d79ee-7906-44aa-8be8-42a63ac24545 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575663 Sep 22 12:31:20.857321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 115/241] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:31:20.874692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e05cabe6-495d-4d13-a7e9-f6ed4beb35f2 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:20.878739 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e05cabe6-495d-4d13-a7e9-f6ed4beb35f2 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:20.959860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e05cabe6-495d-4d13-a7e9-f6ed4beb35f2 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:20.967109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e05cabe6-495d-4d13-a7e9-f6ed4beb35f2 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1214 microversion: 2.1 time: 0.099746 Sep 22 12:31:20.968267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 127/242] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:20 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:21.809342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610b4fcf-09f2-475f-b9df-7a2a9fce13c0"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:21.811917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:21.818800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:21.819284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:21.819718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:21.820439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:21.820887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:21.821309 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:21.865641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:21.866943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:21.876524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:21.877297 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:21.878382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:21.879536 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:21.880251 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:21.880983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:22.086347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:22.112957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-845c38b4-0202-49dd-9816-22c6124004b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1509 microversion: 2.1 time: 0.252959 Sep 22 12:31:22.113489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 128/243] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:21 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:22.118020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:22.118807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:22.125302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:22.125994 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:22.126589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:22.127610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:22.129274 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:22.129896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:22.224817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:22.233720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d25cf754-a8ef-4838-86e0-a3707cccb9a8 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1218 microversion: 2.1 time: 0.119211 Sep 22 12:31:22.234296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 129/244] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:22 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:22.291957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-921173f8-92ba-4176-8397-7e2fc6cc4786 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486996 Sep 22 12:31:22.292798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 116/245] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:31:21 2022] POST /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:23.136625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:23.137338 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:23.143958 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:23.144678 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:23.145457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:23.146330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:23.147122 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:23.147789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:23.258570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:23.259379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:23.267657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:23.269072 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:23.269741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:23.270791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:23.272784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:23.274322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:23.301418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:23.313232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bc368444-1636-4459-a58c-9465025b7b74 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1515 microversion: 2.1 time: 0.181033 Sep 22 12:31:23.313799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 130/246] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:23 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:23.347300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:23.357371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-963bd94d-5f93-484a-b33b-d17709d76e40 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1266 microversion: 2.1 time: 0.104068 Sep 22 12:31:23.358029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 117/247] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:23 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:24.381677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:24.383553 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:24.389762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:24.390332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:24.390838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:24.391608 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:24.392267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:24.392745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:24.467289 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:24.478896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b90ff8b9-83d6-45ac-b511-15d9feb80838 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1272 microversion: 2.1 time: 0.100976 Sep 22 12:31:24.479958 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 131/248] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:24 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:24.712136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6de7e1e3-77f2-40c4-8a7b-c774f61c30af tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: .version_select at 0x7f1079d953a0>, body: {"keypair": {"name": "tempest-keypair-1779644563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwVu3h6fA5RudHe43hIcR30jv6n2uFADD/r0hG5WZymWQHBCd7gxLeLHt7HD+LfS5J5ZKnHurKuLEVEgGZRc53D9D3AWlZh+b0iCX2vorrx4Z3rn1tkvEt4U4IhRnr9qg=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:24.736396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-6de7e1e3-77f2-40c4-8a7b-c774f61c30af tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:24.740870 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-6de7e1e3-77f2-40c4-8a7b-c774f61c30af tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for user 0847f00afbde44068fcf1cedbce24be5 and project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:24.776571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6de7e1e3-77f2-40c4-8a7b-c774f61c30af tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068538 Sep 22 12:31:24.785056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 118/249] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:31:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:25.502393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:25.503633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:25.510062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:25.510548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:25.510977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:25.511716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:25.512995 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:25.513664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:25.535877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:25.748964 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:25.757617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-593e9da3-4ea3-4580-97ca-02dc570b831d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.259347 Sep 22 12:31:25.758187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 132/250] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:25 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:25.895698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b52c26-f91e-4b82-b670-472f3ba2180e", "tag": "303283c4-dee2-46dc-8529-2226ab600b75"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:25.916376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:25.916939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:25.917552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:25.929229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] Creating event network-changed:303283c4-dee2-46dc-8529-2226ab600b75 for instance c1b52c26-f91e-4b82-b670-472f3ba2180e on hv-cinder-85646 Sep 22 12:31:25.934491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4dc82bca-fdf0-4e10-8855-b6271b74b315 req-4bd65b58-9565-4deb-b3a1-16b119f1347f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044943 Sep 22 12:31:25.935157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 119/251] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:26.218638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-47850911", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "networks": [{"uuid": "2491033e-9358-4f00-92f0-d897728f5662"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:26.279848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] validate_networks() for [('2491033e-9358-4f00-92f0-d897728f5662', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:26.509089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1681972035", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8db57afe-6ac0-4ca9-95e4-169c6f6e837a"}], "security_groups": [{"name": "tempest-securitygroup--1292002522"}], "key_name": "tempest-keypair-1779644563", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:26.671141 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] validate_networks() for [('8db57afe-6ac0-4ca9-95e4-169c6f6e837a', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:26.778758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:26.784339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:26.785062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:26.785672 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:26.786284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:26.795516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:26.796113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:26.796669 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:26.797480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:26.798127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:26.798997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:26.818792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Getting quotas for project 543e3a7b5af24948a0ad0519d000e209. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:26.823739 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Getting quotas for user 70d839834f5240dd91c5f7f615ffe36f and project 543e3a7b5af24948a0ad0519d000e209. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:26.837928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:26.840593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:26.895870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c35d348a-8176-4a21-9d7a-e15b064c8af5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680961 Sep 22 12:31:26.896719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 133/252] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:31:26.904104 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:26.904782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:26.911545 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:26.912151 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:26.913315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:26.914200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:26.914844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:26.915432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:27.112509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:27.120439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-95ada587-c2d8-442a-9e97-1ff4bcec7c69 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.222490 Sep 22 12:31:27.121016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 134/253] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:26 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:27.125642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0baad26a-58b1-4fb4-8624-36b10bc72049 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:27.126253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0baad26a-58b1-4fb4-8624-36b10bc72049 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:27.209598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0baad26a-58b1-4fb4-8624-36b10bc72049 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:27.217448 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0baad26a-58b1-4fb4-8624-36b10bc72049 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1212 microversion: 2.1 time: 0.095447 Sep 22 12:31:27.218148 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 135/254] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:27 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1212 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:27.245415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:27.245913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:27.246313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:27.246730 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:27.247146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:27.256837 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:27.257323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:27.257751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:27.258485 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:27.258937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:27.259356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:27.276032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:27.280444 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Getting quotas for user 0847f00afbde44068fcf1cedbce24be5 and project fb62ca26c4fe47deb0a21511a96e6403. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:27.291563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:27.293914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:27.341366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0006914-0082-412a-b5c0-e4293d98cec9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.836788 Sep 22 12:31:27.342238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 120/255] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 12:31:27.355950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-77100f00-0026-4c13-8226-bd211de90c42 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:27.356881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-77100f00-0026-4c13-8226-bd211de90c42 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:27.433975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-77100f00-0026-4c13-8226-bd211de90c42 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:27.446527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-77100f00-0026-4c13-8226-bd211de90c42 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1246 microversion: 2.1 time: 0.094489 Sep 22 12:31:27.448230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 136/256] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:27 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:28.036280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:28.036932 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:28.043863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.044370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.044839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.046448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.047274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.047895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.075974 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-938a9b89-a796-4946-a302-d7351f7a4f07 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/ips" status: 200 len: 147 microversion: 2.1 time: 0.043833 Sep 22 12:31:28.076570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 121/257] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:31:28 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:28.143445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:28.144047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:28.150844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.151326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.151761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.152482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.152935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.153360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.240440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:28.241053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:28.247448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.248082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.248373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.249076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.249557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.249979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.292157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:28.301231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4b3aba20-5055-4b21-9f19-f6b3ad2efd59 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.161496 Sep 22 12:31:28.301824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 137/258] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:28 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:28.473593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:28.474957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:28.487030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.487798 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.488257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.489339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:28.489793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:28.490213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:28.520608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:28.545033 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0e8cebc2-2f6a-4daa-a76f-2e090bdb61aa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1264 microversion: 2.1 time: 0.308651 Sep 22 12:31:28.545636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 122/259] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:28 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:28.585968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:28.594936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cf4c312e-b77e-4e30-b2f5-8908a41797c5 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1298 microversion: 2.1 time: 0.125860 Sep 22 12:31:28.597117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 138/260] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:28 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:29.324701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:29.325312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:29.332008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.332528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.332960 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.333677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.334130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.334551 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.472394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:29.480165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f16cc46-65d5-432f-9725-fd3e8042b75e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.159459 Sep 22 12:31:29.480749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 123/261] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:29 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:29.568628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:29.569334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:29.575784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.576287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.576749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.577448 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.577903 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.578327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.619475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:29.620152 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:29.626540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.627037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.628160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.628331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:29.628790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:29.629214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:29.726992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:29.735006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c558030-c0c5-4625-a7f0-9f49ea4f99c3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1298 microversion: 2.1 time: 0.119492 Sep 22 12:31:29.735568 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 124/262] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:29 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:29.801498 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:29.809257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ba3c8d51-334c-4ac0-ac32-4a9ee14764b0 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.245127 Sep 22 12:31:29.809828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 139/263] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:29 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:30.505819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:30.506516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:30.519902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.521668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.522140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.523826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.525940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.526946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.614337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2142214c-9062-457d-a99a-e6c4cab01e3e", "tag": "a3d9e5a2-42d3-45f5-b648-74d6147d2724"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:30.642654 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.643559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.644337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.658092 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] Creating event network-changed:a3d9e5a2-42d3-45f5-b648-74d6147d2724 for instance 2142214c-9062-457d-a99a-e6c4cab01e3e on hv-cinder-85646 Sep 22 12:31:30.664945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-dc124cd7-0b3e-4e44-8326-55a0cedb7188 req-efc72ae5-c2ee-433d-9609-e563841618ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055823 Sep 22 12:31:30.666041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 140/264] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:30.759352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:30.760539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:30.767072 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.767662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.769375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.770349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.771282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.772052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.914354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:30.925360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d3d7cadb-753a-4ded-b2c2-04e21de869de tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.424840 Sep 22 12:31:30.926188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 125/265] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:30 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:30.933729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:30.934353 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:30.940886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.941471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.941953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:30.942734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:30.943300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:30.944660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:31.030858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:31.042358 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4d99da42-5e28-44c9-9fd5-b6049df4ef7f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.287081 Sep 22 12:31:31.042942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 141/266] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:30 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:31.177284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38fc1b63-44ad-4646-9250-b0df6c86de31 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: .version_select at 0x7f1079de6550>, body: {"keypair": {"name": "tempest-keypair-217052524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjlwowCpqFRw7e/bHc7OLdWXaQ3WRyfyuaB2n4W9ON5Vuhmv8QX8/dWZzD1oe2L5YKSqOuZ9H2KH6N1AOCme6ckvcj8LLoPHlmUte/F8Jh3IIiJZrGyio7lRHPrGAzaDg=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:31.197451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-38fc1b63-44ad-4646-9250-b0df6c86de31 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:31.203152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-38fc1b63-44ad-4646-9250-b0df6c86de31 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:31.231380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38fc1b63-44ad-4646-9250-b0df6c86de31 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060026 Sep 22 12:31:31.232029 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 142/267] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:31:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:31.437237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:31.445889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f3e2428b-cc72-4b4c-8ed4-428611c110fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.518528 Sep 22 12:31:31.446456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 126/268] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:30 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:31.771345 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "830e5da3-6a66-4fc3-9b46-f4fbabf155c1"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:31.774386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:31.781524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:31.781885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:31.782317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:31.783155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:31.783796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:31.784220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:31.848226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:31.861715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:31.862930 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:31.863577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:31.868472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:31.879710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] Creating event network-changed:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:31:31.887267 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-5fb9e40d-8c6d-471a-a07c-0f7165dceee5 req-6440e77e-6fc8-49cf-9f82-e9ca52c566dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044891 Sep 22 12:31:31.888555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 127/269] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:31:31.956767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:31.957482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:31.964811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:31.965308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:31.965746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:31.966444 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:31.966899 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:31.967323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.121545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:32.131030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d0e2e0d-6658-478b-92f0-95c565554b3e tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.179915 Sep 22 12:31:32.132115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 128/270] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:31 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:32.136678 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b52c26-f91e-4b82-b670-472f3ba2180e", "name": "network-vif-plugged", "status": "completed", "tag": "303283c4-dee2-46dc-8529-2226ab600b75"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:32.146153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:32.146677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:32.147116 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.158258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] Creating event network-vif-plugged:303283c4-dee2-46dc-8529-2226ab600b75 for instance c1b52c26-f91e-4b82-b670-472f3ba2180e on hv-cinder-85646 Sep 22 12:31:32.163498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e842593c-01a6-42c7-9aef-5b4170344e75 req-75efbf7e-75be-43e5-80f4-37b2a4c701b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 Sep 22 12:31:32.164082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 129/271] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:32.169008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:32.169705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:32.176311 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:32.176813 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:32.177251 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.177948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:32.178403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:32.178834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.319988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:32.327611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b77b546-9a17-4f1e-b86b-172c05ef08f6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.162368 Sep 22 12:31:32.328506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 130/272] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:32 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:32.469685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:32.470292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:32.476846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:32.477584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:32.478010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.478686 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:32.479129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:32.479542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:32.611173 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:32.629603 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e880e538-a2d1-41fd-87bf-4fdef7a6fab5 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.163661 Sep 22 12:31:32.630187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 131/273] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:32 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:32.847121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f26265da-ae09-4ed0-8de4-dfb50a56a3b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.080400 Sep 22 12:31:32.848017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 143/274] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:31:31 2022] POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments => generated 194 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:33.098283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-219411031", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd"}], "security_groups": [{"name": "tempest-securitygroup--803201308"}], "key_name": "tempest-keypair-217052524", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:33.158226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:33.159053 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:33.165846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.166346 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.166779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.167482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.167935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.168390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.204357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] validate_networks() for [('a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:33.471978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:33.479898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7e31d9ac-111d-4de3-9222-517a46090305 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.326305 Sep 22 12:31:33.480658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 144/275] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:33 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:33.485580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:33.486175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:33.492443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.492921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.493344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.494393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.494843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.495259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.693014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:33.700725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-212ccf6e-5858-4018-8b9d-60f5baaefec1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.218895 Sep 22 12:31:33.701301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 145/276] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:33 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:33.706246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:33.706847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:33.712573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.713057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.713604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.714377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.714832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.715435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.820612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:33.821111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:33.821684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:33.822157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:33.822664 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:33.832016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.832611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.833042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.833791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:33.834242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:33.834662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:33.851959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:33.856392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:33.869949 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:33.873338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:33.882729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:33.910648 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b1b4d583-735b-40e5-b9e1-332b5b64b366 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.204359 Sep 22 12:31:33.911690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 146/277] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:33 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:33.933391 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11aa34f2-f3f1-4751-ae2d-f6f35a9b52af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.839371 Sep 22 12:31:33.934145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 132/278] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:31:33.947392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f5cc9b28-5e61-4653-841c-6e8d1550593a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:33.950704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f5cc9b28-5e61-4653-841c-6e8d1550593a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:34.117296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f5cc9b28-5e61-4653-841c-6e8d1550593a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:34.125317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f5cc9b28-5e61-4653-841c-6e8d1550593a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1240 microversion: 2.1 time: 0.183263 Sep 22 12:31:34.126074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 147/279] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:33 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1240 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:34.504183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:34.504828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:34.506780 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:34.512692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.513178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.513613 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:34.514302 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.514752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.515176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:34.645188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:34.652817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17b61997-2f03-452e-a464-560a28aff05d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1314 microversion: 2.1 time: 0.153727 Sep 22 12:31:34.653388 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 133/280] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:34 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:34.723092 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:34.723700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:34.730954 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.731445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.731889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:34.732773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.733231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.733665 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:34.882755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:34.891419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-272212fb-f9eb-4eb2-a6a6-572cc43ef5c1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.171961 Sep 22 12:31:34.891977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 148/281] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:34 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:34.934234 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:34.934893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:34.941245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.941801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.942300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:34.943061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:34.943610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:34.944091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.075019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:35.082817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4957de2e-c21f-43e9-9686-3a043d6152d4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.152581 Sep 22 12:31:35.083475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 134/282] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:34 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:35.149819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:35.150463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:35.157033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.157504 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.157929 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.158605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.159066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.159474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.219010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:35.226434 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-86104173-0b7c-4169-8474-782003e547c3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1244 microversion: 2.1 time: 0.080457 Sep 22 12:31:35.227010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 149/283] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:35 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:35.675716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:35.676339 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:35.682731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.683218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.683655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.684368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.684826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.685252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.809866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:35.817638 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29f713eb-8f47-48fe-8eb4-f16576e6966f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1463 microversion: 2.1 time: 0.146497 Sep 22 12:31:35.818202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 135/284] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:35 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:35.864768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:35.865265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:35.871453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.871828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.872256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.872981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.873431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.873849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.898551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:31:35.919343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:35.920611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:35.928687 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.929389 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.929995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.930877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:35.931492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:35.932078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:35.993367 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:35.997065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f80b45b2-5c51-43de-ab42-fa5e3041ccff tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 204 len: 0 microversion: 2.1 time: 0.136472 Sep 22 12:31:35.997861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 150/285] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:31:35 2022] DELETE /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:31:36.006771 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:36.007484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:36.013637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.014101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.014537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.015251 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.015712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.016139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.021946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:36.140022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:36.149348 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0665d7f5-054a-4fd2-93bb-bd7580a4a671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.238370 Sep 22 12:31:36.150371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 136/286] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:35 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:36.163959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2142214c-9062-457d-a99a-e6c4cab01e3e", "name": "network-vif-plugged", "status": "completed", "tag": "a3d9e5a2-42d3-45f5-b648-74d6147d2724"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:36.174747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.175308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.175839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.187146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] Creating event network-vif-plugged:a3d9e5a2-42d3-45f5-b648-74d6147d2724 for instance 2142214c-9062-457d-a99a-e6c4cab01e3e on hv-cinder-85646 Sep 22 12:31:36.191982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b0beaeaf-589b-4c55-8d18-ce7635b7a339 req-1e4a95d0-976c-4f12-aa67-19a7a72b8ee1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040297 Sep 22 12:31:36.192710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 137/287] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:36.198187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:36.198953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:36.204689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:36.205292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.206325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.206913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.207504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.207955 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.208404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.212786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-64cbe70a-2345-4d17-a423-8f33deda38a4 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1469 microversion: 2.1 time: 0.210654 Sep 22 12:31:36.213350 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 151/288] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:36 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:36.249695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:36.250311 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:36.256431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.256968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.257585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.258313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:36.258759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:36.259176 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:36.336325 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:36.344074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b13c0735-cb7f-4679-abd7-3d031e1aa95b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1236 microversion: 2.1 time: 0.098163 Sep 22 12:31:36.344953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 152/289] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:36 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:36.363765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:36.371314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1cd2781a-6abc-4d6c-9a66-8b9a6fad6c45 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.177305 Sep 22 12:31:36.371877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 138/290] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:36 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:37.172117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:37.172753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:37.175194 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:37.181291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.181834 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.182273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.182972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.183426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.183855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.236450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:37.237721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:37.244076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.244588 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.245025 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.245716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.246164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.246590 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.372609 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:37.380231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bf9e310d-78e2-4fce-8bd3-1d3087f2d80d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.211941 Sep 22 12:31:37.380825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 153/291] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:37 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:37.385948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:37.386562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:37.392610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.393102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.393539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.394240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.394696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.395127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.402131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:37.411916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-496b2a22-1864-4e0f-b169-0d8fc24124bb tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1469 microversion: 2.1 time: 0.179300 Sep 22 12:31:37.423765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 139/292] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:37 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:37.423765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:37.423765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:37.429321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.429805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.430235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.430955 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:37.431401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:37.431819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:37.458058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:37.475399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-af4195de-f641-4960-a560-13f01547314a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1236 microversion: 2.1 time: 0.093541 Sep 22 12:31:37.475975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 154/293] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:37 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:37.570058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:37.579279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ad5ccd7a-f289-4585-9d9a-9936fc4bc1b2 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.164918 Sep 22 12:31:37.579854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 140/294] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:37 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:38.403175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:38.403785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:38.413857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.416087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.416635 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.417426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.417977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.418478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.437558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:38.439390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:38.449232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.450172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.450798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.451798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.452765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.453416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.533713 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:38.550493 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-503fbc21-70ef-4996-809b-0c4f1fa1b79f tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1427 microversion: 2.1 time: 0.119267 Sep 22 12:31:38.551286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 141/295] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:38 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1427 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:38.556658 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:38.557447 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:38.563621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.564438 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.565742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.566595 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.567196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.567764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.623755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:38.632287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2c64dd15-bded-4c9f-84c6-281f3d149acc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.232985 Sep 22 12:31:38.632987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 155/296] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:38 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:38.638327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b52c26-f91e-4b82-b670-472f3ba2180e", "name": "network-vif-deleted", "tag": "303283c4-dee2-46dc-8529-2226ab600b75"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:38.641772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:38.650871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7400bb0d-4767-484b-9680-11222c407186 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1292 microversion: 2.1 time: 0.098396 Sep 22 12:31:38.651487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 142/297] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:38 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:38.656345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:38.656957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:38.662676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.663157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.663585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.663693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.664160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.664667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.665367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:38.665818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:38.666248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:38.682062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] Creating event network-vif-deleted:303283c4-dee2-46dc-8529-2226ab600b75 for instance c1b52c26-f91e-4b82-b670-472f3ba2180e on hv-cinder-85646 Sep 22 12:31:38.687008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-16191903-1617-4cbf-949c-439eef29c02e req-f15e1d94-7d35-4b53-9f50-5fa1c901d6e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052616 Sep 22 12:31:38.687600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 156/298] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:38.797901 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:38.806471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bf445704-7b8e-4230-bff1-cdd4085c5413 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1312 microversion: 2.1 time: 0.153741 Sep 22 12:31:38.807034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 143/299] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:38 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:39.575931 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:39.576655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:39.583485 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.583966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.584443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.585128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.585580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.586003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.646792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:39.654488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8ffeddbd-fb47-4b5e-9f5b-3990a27a2058 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1299 microversion: 2.1 time: 0.083253 Sep 22 12:31:39.654795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:39.655208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 157/300] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:39 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:39.655441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:39.662201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.662689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.663124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.663814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.664269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.664719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.677648 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:39.678258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:39.684020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.684566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.684998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.685683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.686140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.686558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.762568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:39.770249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b9cb619e-5e46-4d73-a2e5-4519767416af tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1300 microversion: 2.1 time: 0.096223 Sep 22 12:31:39.770734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 158/301] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:39 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:39.820655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:39.828758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:39.828940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae1e2060-79f0-4f82-b92c-38ad49b674f1 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.177674 Sep 22 12:31:39.829279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 144/302] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:39 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:39.829445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:39.835111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.835585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.836016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.836730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:39.837176 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:39.837591 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:39.994175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:40.003630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0e3224e0-1f32-471d-9637-5656e67f09c6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1496 microversion: 2.1 time: 0.178683 Sep 22 12:31:40.004395 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 159/303] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:39 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1496 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:40.046470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "name": "network-vif-plugged", "status": "completed", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:40.058091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.058659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.059154 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.071083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] Creating event network-vif-plugged:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:31:40.076499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-afca5982-ad1d-4289-8589-0ece8a75ab58 req-ab03365a-c820-4f53-b24b-3cf4cb0e3a7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033654 Sep 22 12:31:40.077107 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 145/304] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:40.523912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:40.524441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:40.530436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.530925 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.531357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.532041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.532521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.532942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.558181 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:31:40.631881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3ebe6e91-17f9-49d0-a534-d3ad482153ea tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 204 len: 0 microversion: 2.1 time: 0.111592 Sep 22 12:31:40.632551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 160/305] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:31:40 2022] DELETE /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:31:40.641070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:40.641790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:40.647939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.648449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.648883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.649558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.650003 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.650420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.677846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:40.678574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:40.684616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.685096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.685638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.686326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.686771 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.687187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.718716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.719189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.719615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.720048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lazy-loading 'fault' on Instance uuid c1b52c26-f91e-4b82-b670-472f3ba2180e {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:40.773674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:40.781948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5482890c-af67-4f98-ab42-15ec94076231 tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1304 microversion: 2.1 time: 0.108725 Sep 22 12:31:40.782522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 161/306] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:40 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:40.793040 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:40.793891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:40.800519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.801000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.801429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.802118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.802564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.802977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.817017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:40.854498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a2a9d23-62cc-40c5-aa8f-3a2591dcad32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1502 microversion: 2.1 time: 0.190202 Sep 22 12:31:40.860063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 146/307] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:40 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:40.873662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:40.875820 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:40.890475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.891458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.891919 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.892670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:40.893167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:40.893718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:40.920350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:40.932037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:40.941373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c9e33f11-167d-4508-8617-db9781f31524 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1298 microversion: 2.1 time: 0.152364 Sep 22 12:31:40.949164 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 162/308] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:40 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:41.039309 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:41.047078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a2f67f01-ed4b-4c08-b2ec-b8d41abfc783 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.185944 Sep 22 12:31:41.047637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 147/309] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:40 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:41.539101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:41.545248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.545676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.546112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.606882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Going to try to stop instance {{(pid=120604) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 12:31:41.648011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a185d596-2493-41bd-94e2-c30008a7126a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action" status: 202 len: 0 microversion: 2.1 time: 0.112680 Sep 22 12:31:41.648808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 163/310] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:31:41 2022] POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:31:41.656829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:41.657464 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:41.663793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.664271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.664730 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.665404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.665851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.666267 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.791726 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:41.800880 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a8cf73c-ba1e-4972-b88a-edc6ace38006 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.147814 Sep 22 12:31:41.801441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 148/311] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:41 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:41.807022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:41.807706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:41.813842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.814323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.814775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.815455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.815898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.816327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.848932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.849398 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.849821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.850252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lazy-loading 'fault' on Instance uuid c1b52c26-f91e-4b82-b670-472f3ba2180e {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:41.884997 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:41.886373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:41.893026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.893465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.893906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.894599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.895049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.895471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.895895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:41.903633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c96201b6-dddb-49a3-9943-9272b151bf4b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1304 microversion: 2.1 time: 0.100765 Sep 22 12:31:41.904187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 164/312] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:41 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:41.963976 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:41.964697 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:41.970527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.971660 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.972098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.972803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:41.973249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:41.973666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:41.978012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:42.046004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:42.051116 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:42.054633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b198824f-c520-48ee-a178-c6c33c586e2c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1298 microversion: 2.1 time: 0.094422 Sep 22 12:31:42.055374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 165/313] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:41 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1298 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:42.060894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6f41a0b-6766-47c7-bb14-70165c0e901b tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1502 microversion: 2.1 time: 0.179915 Sep 22 12:31:42.063206 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 149/314] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:41 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:42.095313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:42.095948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:42.106130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.106672 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.107307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.108451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.109258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.109686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.241520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:42.249387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f70e6e03-4fe6-4bc7-80f5-e3024f22af18 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.180501 Sep 22 12:31:42.249946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 166/315] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:42 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:42.826898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:42.828101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:42.838885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.839391 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.839896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.840638 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.841252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.841810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.927960 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:42.929016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:42.935565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.936154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.936832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.937748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.938391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.939163 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.979718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:42.980366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:42.981030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:42.982945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lazy-loading 'fault' on Instance uuid c1b52c26-f91e-4b82-b670-472f3ba2180e {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:43.048789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:43.057328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-99787664-a31b-40e4-ab9a-d8b50fc2518c tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1304 microversion: 2.1 time: 0.134138 Sep 22 12:31:43.073428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 167/316] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:42 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:43.096701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:43.097702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:43.098388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:43.106506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.107220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.107886 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.108512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff3cd02d-2cd1-4e4f-a343-04f172e10ebd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.288909 Sep 22 12:31:43.108844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.109300 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.109725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.110405 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 150/317] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:42 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:43.116070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:43.116983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:43.123699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.124605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.125191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.126262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.126986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.128289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.469825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:43.473019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:43.478328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f58bbcf-74be-4131-a6bd-2078207d6279 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1502 microversion: 2.1 time: 0.387526 Sep 22 12:31:43.478929 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 168/318] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:43 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1502 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:43.489197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c0167e12-be75-465d-9347-62be26d2d92b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.370545 Sep 22 12:31:43.489317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:43.489317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:43.491302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.491791 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.492224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.492791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 151/319] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:43 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:43.493010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.493458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.493879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.503069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d298c197-bf2c-41e0-a0d0-f0f48e979904", "tag": "3de3f767-ed67-4ebd-ad2d-e94ea3db7b53"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:43.512871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.513525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.513954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.525320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] Creating event network-changed:3de3f767-ed67-4ebd-ad2d-e94ea3db7b53 for instance d298c197-bf2c-41e0-a0d0-f0f48e979904 on hv-cinder-85646 Sep 22 12:31:43.529998 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-36e00343-4cd0-40f8-b4de-93fe4c09972c req-1a25cb46-aa15-4d36-9441-c3910ed1b59e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034885 Sep 22 12:31:43.530583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 152/320] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:43.535549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2142214c-9062-457d-a99a-e6c4cab01e3e", "name": "network-vif-deleted", "tag": "a3d9e5a2-42d3-45f5-b648-74d6147d2724"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:43.544889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:43.545367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:43.545796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:43.557835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] Creating event network-vif-deleted:a3d9e5a2-42d3-45f5-b648-74d6147d2724 for instance 2142214c-9062-457d-a99a-e6c4cab01e3e on hv-cinder-85646 Sep 22 12:31:43.565315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-102db46d-3db9-4ee9-b549-c8e8460bf716 req-e359d384-87f7-4859-bce3-196bdb977856 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Sep 22 12:31:43.566226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 153/321] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:43.853533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:43.863420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a4258863-e5cf-42a9-84a4-b2e41ed18afd tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1372 microversion: 2.1 time: 0.383438 Sep 22 12:31:43.864101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 169/322] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:43 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:44.081833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:44.082532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:44.084945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:44.085606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=22 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:44.092099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.092599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.093034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.093715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.094171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.094597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.126821 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.127338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.127742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.128183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lazy-loading 'fault' on Instance uuid c1b52c26-f91e-4b82-b670-472f3ba2180e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:44.137343 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:44.138030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:44.140499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=18 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:44.145917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.146404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.146835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.147533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.147981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.148432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.175730 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f090f1b5d1449fca5f077b6f6a9be1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64ab512913704ae1b116cd0c3189760b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:44.188283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0813a6e-3564-4ed3-9f76-659f7ad39d8b tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 200 len: 1304 microversion: 2.1 time: 0.110899 Sep 22 12:31:44.188902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 154/323] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:44 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:44.326640 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:44.336396 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5a1e3cd-0e5e-4a8c-83db-266c65aa5e8a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.202802 Sep 22 12:31:44.336975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 170/324] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:44 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:44.502281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:44.502906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:44.507418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:44.508285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:44.509062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.509552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.509989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.510744 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.511131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.511554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.515796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.516390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.517202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.518520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.519056 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.519474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.549216 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.549704 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.550145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.550589 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lazy-loading 'fault' on Instance uuid 2142214c-9062-457d-a99a-e6c4cab01e3e {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:44.612482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:44.621470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1b4b739a-49a4-4e49-a133-6a24cbef8ea4 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 200 len: 1302 microversion: 2.1 time: 0.122610 Sep 22 12:31:44.632761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 155/325] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:44 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 1302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:44.709203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:44.719201 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7733aea8-d787-4ebc-a625-a0366390f3d5 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.216406 Sep 22 12:31:44.720072 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 171/326] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:44 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:44.885697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:44.886312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:44.892182 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.892706 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.893896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:44.894685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:44.895145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:44.895570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.132629 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:45.140451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca96291a-f52f-43ea-859c-6778db09333b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1567 microversion: 2.1 time: 0.258561 Sep 22 12:31:45.141009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 156/327] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:44 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:45.162488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:45.163031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:45.169259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.169738 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.170170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.170852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.171307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.171724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.211437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:45.212170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] [instance: c1b52c26-f91e-4b82-b670-472f3ba2180e] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:45.218243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.218808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.219312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.220073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.220631 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.221060 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.234763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] HTTP exception thrown: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Request method failure captured: Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e HTTP/1.1 Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFWW0mVIT1vOEiHUN22IqgmUkmAYaluMjyPzUmKj1o6qnTdAR-ImKaJGHGPzQqirmquQgfjYJwkFVvPioWydHb-bBlWuyZ8RsWwQRG61v7BucDGV2XIAo9vvnR0ujzuGV56XXaeRtp7Zh3ti6oS93EZ7u8_eVAsOiC-9b_0BkQUKfNc Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 64ab512913704ae1b116cd0c3189760b Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1923349799 Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:31:45.236454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64ab512913704ae1b116cd0c3189760b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/64ab512913704ae1b116cd0c3189760b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/64ab512913704ae1b116cd0c3189760b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_64ab512913704ae1b116cd0c3189760b"}]}] Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1923349799 Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 64ab512913704ae1b116cd0c3189760b Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1923349799 Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1923349799-project Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 0f090f1b5d1449fca5f077b6f6a9be1f Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1923349799-project Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. Sep 22 12:31:45.238605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'c1b52c26-f91e-4b82-b670-472f3ba2180e'} Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:31:45.239495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. Sep 22 12:31:45.246135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.248812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] Returning 404 to user: Instance c1b52c26-f91e-4b82-b670-472f3ba2180e could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:31:45.248812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ad930db-1255-4c92-bb97-18da6a54498d tempest-VolumesNegativeTest-1923349799 tempest-VolumesNegativeTest-1923349799-project] 10.222.0.33 "GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e" status: 404 len: 111 microversion: 2.1 time: 0.030873 Sep 22 12:31:45.248812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 157/328] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:45 2022] GET /compute/v2.1/servers/c1b52c26-f91e-4b82-b670-472f3ba2180e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:31:45.266226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5329c2bc-048f-4369-a018-18a1845ff1ca tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107483 Sep 22 12:31:45.266987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 172/329] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:31:45 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:45.360985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:45.362244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:45.368116 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.368693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.369196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.369956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.370474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.371073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.644107 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:45.645034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:45.645436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: 2142214c-9062-457d-a99a-e6c4cab01e3e] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:45.651919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.652751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.653421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.654406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.655202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.655859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.656767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-442db4e0-24c9-4a6a-90a5-6b8bb740b689 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.299814 Sep 22 12:31:45.665230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 158/330] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:45 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:45.679200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] HTTP exception thrown: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Request method failure captured: Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e HTTP/1.1 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFWcC3n8FI7GLVJiqVGtfkEi594mUAXN-gTDg6PylWInWVi4lWDBbVDZL4QH6MOJaJJiqBOLK58S2GpXNsdXEhJRkodXptW5g4VYhff46-QQCXoXU_AhuZEn_xy1I85VE8JMq_EMSjnkx9dTfa80QsfVQrfn3HQPM1FMYW5UD3e7hwo Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 543e3a7b5af24948a0ad0519d000e209 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesActionsTest-963501249 Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:31:45.681078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_543e3a7b5af24948a0ad0519d000e209"}]}] Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesActionsTest-963501249 Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 543e3a7b5af24948a0ad0519d000e209 Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesActionsTest-963501249 Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesActionsTest-963501249-project Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 70d839834f5240dd91c5f7f615ffe36f Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesActionsTest-963501249-project Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. Sep 22 12:31:45.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '2142214c-9062-457d-a99a-e6c4cab01e3e'} Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:31:45.684286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. Sep 22 12:31:45.685558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:31:45.686607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Returning 404 to user: Instance 2142214c-9062-457d-a99a-e6c4cab01e3e could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:31:45.686607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ce20ebec-5fa0-46c5-9c8a-292143cf32ef tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e" status: 404 len: 111 microversion: 2.1 time: 0.042933 Sep 22 12:31:45.686607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 173/331] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:45 2022] GET /compute/v2.1/servers/2142214c-9062-457d-a99a-e6c4cab01e3e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:31:45.740328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1953454455", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "networks": [{"uuid": "2491033e-9358-4f00-92f0-d897728f5662"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:45.743449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:45.744507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:45.750625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.751129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.751562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.753108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:45.753592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:45.754596 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:45.813626 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] validate_networks() for [('2491033e-9358-4f00-92f0-d897728f5662', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:46.073226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:46.083012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a74b2747-e32f-4a1e-8252-8b25bea4997e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.343382 Sep 22 12:31:46.084076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 174/332] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:45 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:46.512446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:46.512953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:46.513365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:46.513731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:46.514135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:46.523104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:46.523575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:46.524000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:46.524742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:46.525192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:46.525607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:46.543857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Getting quotas for project 543e3a7b5af24948a0ad0519d000e209. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:46.549903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Getting quotas for user 70d839834f5240dd91c5f7f615ffe36f and project 543e3a7b5af24948a0ad0519d000e209. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:46.562036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:46.564656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:46.621719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b29d6254-0dd9-4173-8d2c-c956c4427f68 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886665 Sep 22 12:31:46.629286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 159/333] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:31:46.634829 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5b6a72aa-7d5c-440e-9c27-bff07f6d08dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:46.635839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5b6a72aa-7d5c-440e-9c27-bff07f6d08dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:46.692671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:46.694225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:46.706132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:46.706707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:46.707434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:46.708374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:46.709025 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:46.710097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:46.898922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5b6a72aa-7d5c-440e-9c27-bff07f6d08dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:46.908219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5b6a72aa-7d5c-440e-9c27-bff07f6d08dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1214 microversion: 2.1 time: 0.277874 Sep 22 12:31:46.914019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 175/334] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:46 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1214 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:47.017633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:47.027934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0dc3e850-4652-490c-b595-9da87aedda42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.347514 Sep 22 12:31:47.038711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 160/335] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:46 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:47.106655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:47.107218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:47.120034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:47.120568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:47.120997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:47.122029 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:47.122486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:47.122930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:47.171345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:47.194675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:47.195330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:47.195767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:47.216202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] Creating event network-changed:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:31:47.227912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8c129a4c-6f55-489b-9c71-86c97490eeea req-bd4dd37d-0e4b-4c79-9ad4-5adb63656b4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061716 Sep 22 12:31:47.231080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 161/336] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:47.343046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:47.358326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-74bfe113-ad5a-4c12-b0cb-e24b98cfdbb0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.253478 Sep 22 12:31:47.365417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 176/337] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:47 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:47.935634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:47.936667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:47.954497 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:47.954982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:47.956035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:47.956765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:47.968880 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:47.969320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:48.038806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:48.047450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6bb21b80-82ad-42bb-9cfc-404207f68f08 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1266 microversion: 2.1 time: 0.116004 Sep 22 12:31:48.048266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 162/338] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:47 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:48.065211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:48.066473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:48.072652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:48.073131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:48.073560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:48.074254 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:48.074701 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:48.075118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:48.250098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:48.269008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9f59c489-a506-497b-a9d9-c6d66300e25c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.215590 Sep 22 12:31:48.269588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 177/339] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:48 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:48.385955 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:48.386583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:48.398199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:48.398199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:48.398199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:48.398199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:48.398529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:48.398529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:48.700317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:48.718442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b5e16e1-e051-4e21-a811-b1faf6615f21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.339918 Sep 22 12:31:48.719029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 163/340] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:48 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:49.073697 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:49.076095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:49.083492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.084515 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.084945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.085643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.086125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.086545 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.276947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:49.284634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-88fbe929-79ba-4984-aea0-7914a95283dc tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.214772 Sep 22 12:31:49.285198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 178/341] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:49 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:49.292798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:49.293597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:49.299734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.300258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.300738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.301437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.301891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.302318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.557059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:49.565263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5fa80ece-0d83-4453-9b7b-c8b6e42af44b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.276349 Sep 22 12:31:49.565824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 164/342] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:49 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:49.743996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:49.744688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:49.757978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.758477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.758915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.759621 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:49.760074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:49.760539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:49.968844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:49.978131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f333425-485a-4a40-8998-8fd4f184d42b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.240380 Sep 22 12:31:49.979013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 179/343] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:49 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:50.091941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67d61f3-2119-4f47-80d4-7b702eefb87b", "tag": "0f5cd551-a4b0-4894-b298-b24f7adf9e64"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:50.114224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.115030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.115754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.126692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d298c197-bf2c-41e0-a0d0-f0f48e979904", "name": "network-vif-plugged", "status": "completed", "tag": "3de3f767-ed67-4ebd-ad2d-e94ea3db7b53"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:50.150651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.151581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.152505 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.157752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] Creating event network-changed:0f5cd551-a4b0-4894-b298-b24f7adf9e64 for instance a67d61f3-2119-4f47-80d4-7b702eefb87b on hv-cinder-85646 Sep 22 12:31:50.173917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b6e4a73e-f0c9-4626-b38d-e1b931c90203 req-fb38036f-d370-480f-b48c-e9954d64aa76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087309 Sep 22 12:31:50.175038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 165/344] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:50.177157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] Creating event network-vif-plugged:3de3f767-ed67-4ebd-ad2d-e94ea3db7b53 for instance d298c197-bf2c-41e0-a0d0-f0f48e979904 on hv-cinder-85646 Sep 22 12:31:50.184202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-893cfdfc-50e8-4498-89b3-be527e740155 req-73231de3-5375-437e-8f17-c01a98968c86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061717 Sep 22 12:31:50.185709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 180/345] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:50.308426 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:50.309705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:50.317167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.317860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.318304 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.319022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.319479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.319972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.529641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:50.537486 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8518b01-629c-44f3-b099-d72ad8dcd9fa tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.233677 Sep 22 12:31:50.538127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 166/346] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:50 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:50.589510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:50.590212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:50.596956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.597568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.598060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.598814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:50.599363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:50.599848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:50.784584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:50.793610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5ff414f6-7cb8-40d8-8390-257719a8d9d4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.208462 Sep 22 12:31:50.794447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 181/347] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:50 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:51.001854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:51.002488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:51.008653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.009128 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.009559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.010237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.010680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.011099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.015160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:51.147867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:51.155525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-897d4d1a-0095-478b-b08f-639a9ac1415f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.157587 Sep 22 12:31:51.156087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 167/348] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:50 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:51.562055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:51.562676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:51.570860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.571418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.572009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.572758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.573215 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.573827 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.795570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:51.803753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-21c5fa90-6ce5-4c4c-9ba3-bea42add8f72 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.246768 Sep 22 12:31:51.804416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 182/349] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:51 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:51.818252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:51.819624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:51.825963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.826526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.827034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.827858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:51.828467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:51.829081 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:51.979766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:51.989459 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c3112496-3f1b-47d2-902a-d9edacb0370c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.175990 Sep 22 12:31:51.990032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 168/350] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:51 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:52.177764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:52.178533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:52.184455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:52.184936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:52.185364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:52.186044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:52.186490 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:52.186906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:52.319423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:52.328831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-68fc70ac-6b21-484c-b90b-398baec52a55 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1365 microversion: 2.1 time: 0.154788 Sep 22 12:31:52.329589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 183/351] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:52 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:52.828500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:52.829150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:52.835350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:52.835837 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:52.836276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:52.837050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:52.837507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:52.837929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:52.969149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:52.977554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0ec388d-5ab4-4022-8715-090cd71f07e8 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.152729 Sep 22 12:31:52.978122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 169/352] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:52 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:53.016702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:53.017450 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:53.023880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.024411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.024847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.025539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.025997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.026427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.030435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:53.160920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:53.170862 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1cb2c0d6-5ece-4e4f-8905-77063f5fb730 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.158038 Sep 22 12:31:53.171425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 184/353] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:53 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:53.353258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:53.353868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:53.360646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.361127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.361586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.362272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.362719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.363137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.498895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-348001288", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "networks": [{"uuid": "132b9a18-7a8b-4760-bd77-25e68aa07772"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:53.553679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] validate_networks() for [('132b9a18-7a8b-4760-bd77-25e68aa07772', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:31:53.594640 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:53.603224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-39e5b2e7-3beb-46d1-b31e-4c2a9c981bfc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1556 microversion: 2.1 time: 0.254075 Sep 22 12:31:53.603780 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 170/354] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:53 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:53.627721 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:53.628327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:53.634315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.634796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.635226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.635912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.636611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.637035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.731743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-51ee86d5-5c1d-4526-8ea0-3d10ce55a7f9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109354 Sep 22 12:31:53.732371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 171/355] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:31:53 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:31:53.958158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:31:53.958589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:31:53.959067 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:31:53.959480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:31:53.959930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:31:53.968990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.969482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.969912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.970717 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:53.971947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:53.972119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:53.995339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Getting quotas for project 24db83f7bc4d4888b73d4d4ab7c4bdce. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:31:53.998412 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Getting quotas for user 44c2913f48ad4200b6baf14c0830770c and project 24db83f7bc4d4888b73d4d4ab7c4bdce. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:31:54.001201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:54.002442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:54.008735 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:54.009495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:54.010140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:54.010255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:31:54.011174 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:54.011837 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:54.012529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:54.012642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:31:54.052195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:54.085369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b36016cf-b932-4a78-99cd-fb74b0065295 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590202 Sep 22 12:31:54.086018 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 185/356] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 12:31:54.106722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b25e34f7-e417-4016-8180-da5e8725c816 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:54.108511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b25e34f7-e417-4016-8180-da5e8725c816 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:54.201883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b25e34f7-e417-4016-8180-da5e8725c816 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:54.216008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b25e34f7-e417-4016-8180-da5e8725c816 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1218 microversion: 2.1 time: 0.111972 Sep 22 12:31:54.220663 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 186/357] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:54 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:54.227562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:54.234032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:54.241621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:54.251231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:54.251773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:54.253787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:54.255166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3c730b92-0673-4a5a-9e45-926cb8e3608a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.258303 Sep 22 12:31:54.255445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:54.255950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 172/358] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:53 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:54.256070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:54.256383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:54.400675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:54.409660 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-eb5112e1-3ecf-4b40-aebd-5ae575b6c407 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.186705 Sep 22 12:31:54.410555 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 187/359] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:54 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:55.140609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d298c197-bf2c-41e0-a0d0-f0f48e979904", "tag": "3de3f767-ed67-4ebd-ad2d-e94ea3db7b53"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:55.151173 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.151647 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.152068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.164220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] Creating event network-changed:3de3f767-ed67-4ebd-ad2d-e94ea3db7b53 for instance d298c197-bf2c-41e0-a0d0-f0f48e979904 on hv-cinder-85646 Sep 22 12:31:55.169927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d93cd076-6ffd-4114-850c-a10b98801256 req-a90b502f-a373-4768-b607-9ce504bf4fcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032921 Sep 22 12:31:55.170665 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 173/360] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:55.240358 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:55.240724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:55.247145 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.247632 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.248074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.248799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.249393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.249820 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.279675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:55.280541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:55.284376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:55.289201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.289809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.290337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.291126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.291672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.292185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.319907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:55.328134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-009b7d1f-efe8-4d82-ab16-cf4894734842 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1270 microversion: 2.1 time: 0.092543 Sep 22 12:31:55.328741 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 188/361] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:55 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:55.426159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:55.434716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bc0200b6-2b9c-4bad-b976-0d40d8969136 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.159196 Sep 22 12:31:55.434923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:55.435481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 174/362] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:55 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:55.435663 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:55.442226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.442226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.442750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.443511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:55.444016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:55.444537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:55.572322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:55.581066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-287e974f-0ffd-4582-b7e6-49ae6e1c4119 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.149991 Sep 22 12:31:55.581626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 189/363] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:55 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:56.113608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67d61f3-2119-4f47-80d4-7b702eefb87b", "name": "network-vif-plugged", "status": "completed", "tag": "0f5cd551-a4b0-4894-b298-b24f7adf9e64"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:56.124801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.125969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.126696 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.139369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] Creating event network-vif-plugged:0f5cd551-a4b0-4894-b298-b24f7adf9e64 for instance a67d61f3-2119-4f47-80d4-7b702eefb87b on hv-cinder-85646 Sep 22 12:31:56.147204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-1ed7474b-dbe1-48be-b6c4-faaf9a504d5c req-d66b28f7-3070-4058-8d81-73b9eeab901c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Sep 22 12:31:56.148887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 175/364] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:31:56.351747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:56.352646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:56.360162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.361055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.362286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.363605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.364037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.364924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.458032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:56.458940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:56.466336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.468324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.468998 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.470110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.470861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.476929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.532833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:56.557717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:31:56.721620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:56.730789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4d2c5d98-c7cf-49f4-b018-897666c53925 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.383222 Sep 22 12:31:56.731371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 190/365] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:56 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:56.737121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:56.737736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:56.740751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:56.748581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d23ab442-7a66-48a7-b38d-8c5494e523fb tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.295463 Sep 22 12:31:56.749145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 176/366] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:56 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:56.756181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:56.756703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:56.762534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.763034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.763474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.764184 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.764672 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.765101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.771531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.772035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.772627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.773345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:56.773827 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:56.774258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:56.799572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8c7c559-9237-4800-97cd-2b4a979bfa11 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/ips" status: 200 len: 152 microversion: 2.20 time: 0.046356 Sep 22 12:31:56.800148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 177/367] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Sep 22 12:31:56 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:31:56.903179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:56.912142 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-916de7d5-88f4-4b46-8cb3-954418df358e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.179673 Sep 22 12:31:56.912962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 191/368] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:56 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:57.256188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d04cb8b-ca1a-46fa-995c-e2d41d452e06", "tag": "542f47ac-43dd-4d65-b99a-3389e7f5abdc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:57.265385 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:57.265852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:57.266273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:57.277396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] Creating event network-changed:542f47ac-43dd-4d65-b99a-3389e7f5abdc for instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 on hv-cinder-85646 Sep 22 12:31:57.282040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c52e4c0e-6813-478c-b053-06d0b2b1415a req-defb35be-7950-4582-b336-85e11756d356 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029640 Sep 22 12:31:57.282621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 178/369] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:31:57.754334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:57.754848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:57.761493 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:57.761966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:57.762393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:57.763079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:57.763520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:57.763936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:57.773905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:57.775077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:57.781472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:57.782043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:57.782549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:57.783487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:57.784226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:57.784864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:57.967393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:57.972399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:57.975250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-29c255d5-7529-41f1-8b75-b46cdf8cd722 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.225506 Sep 22 12:31:57.980779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d46fc23b-b1da-44a1-a4a3-622885cdce38 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1314 microversion: 2.1 time: 0.211800 Sep 22 12:31:57.981600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 179/370] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:57 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:57.992576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 192/371] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:57 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:57.996382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:57.997131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:58.003928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:58.005138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:58.005516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:58.006212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:58.006661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:58.007084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:58.136005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:58.144319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-762bca14-b124-4ba9-9f1b-9fe7461121d9 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.155760 Sep 22 12:31:58.144887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 193/372] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:57 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:58.999937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.000578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.006986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.007604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.007863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.008433 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.008888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.010114 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.010114 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.010450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.014875 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.015362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.015968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.017010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.018261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.018844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.219692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.222779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.231373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c28548b3-23f2-4490-9b49-3554b65474f0 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.235265 Sep 22 12:31:59.231806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8be02668-c874-45bb-b6e7-89a89eb1f960 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1499 microversion: 2.1 time: 0.230791 Sep 22 12:31:59.232336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 180/373] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:58 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:59.237494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.238159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.239893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 194/374] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:58 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1499 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:31:59.244425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.244992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.245495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.246102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:31:59.246316 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.246839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.247336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.247639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.256098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.256877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.257662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.258562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.259322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.260154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.289972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lazy-loading 'flavor' on Instance uuid 15c97c51-b54b-48e0-9929-cc535246eb97 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:31:59.412271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.422755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cfa221d2-1737-41ea-91d7-a75484be7ebf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.189566 Sep 22 12:31:59.424842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 181/375] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:59 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:31:59.507225 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-31bd0c81-2ae7-4a63-8f54-7e5acacc419d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/action" status: 202 len: 0 microversion: 2.20 time: 0.265807 Sep 22 12:31:59.507940 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 195/376] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 22 12:31:59 2022] POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:31:59.515797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.516432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.522463 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.522950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.523382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.524083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.524556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.524980 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.655226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.663807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.665287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:31:59.666736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc06bc54-b016-4437-bd1c-ef9f92828f5d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.154752 Sep 22 12:31:59.667292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 182/377] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:31:59 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:31:59.780317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.781032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.787642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.788124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.788578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.789258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.789703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.790119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.815447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:31:59.892780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4929fc9f-8347-4468-aab2-28cf9021f68a tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 204 len: 0 microversion: 2.1 time: 0.116453 Sep 22 12:31:59.893376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 196/378] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:31:59 2022] DELETE /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:31:59.901351 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:31:59.901946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:31:59.907778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.908736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.909164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:31:59.909840 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:31:59.910281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:31:59.910692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.045992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.053733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-54532a1e-2566-48fb-945b-13d828a20e32 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1505 microversion: 2.1 time: 0.156207 Sep 22 12:32:00.054299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 183/379] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:31:59 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:00.268078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:00.268724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:00.275097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.275579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.276013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.276737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.277187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.277639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.406993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.414533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-12bbc990-165e-4834-a73e-09bbc6b62290 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.151272 Sep 22 12:32:00.415090 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 197/380] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:00 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:00.447898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:00.448541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:00.454328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.454806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.455848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.456548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.456992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.457407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.581483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.589605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37833553-0915-4833-9474-f06291183e97 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.145490 Sep 22 12:32:00.590167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 184/381] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:00 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:00.695299 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:00.696348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:00.703336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.703554 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.704022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.704895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:00.706025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:00.706428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:00.835973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.838755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:00.847849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.849308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:00.850452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5954d352-0b0b-4325-926f-84749663ae51 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.161478 Sep 22 12:32:00.850996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 198/382] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:00 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:01.076224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:01.076872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:01.083307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.083789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.084223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.084932 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.085384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.085807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.223701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:01.231581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80c6d438-866a-4da2-9848-3e3475b78bf6 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1505 microversion: 2.1 time: 0.159183 Sep 22 12:32:01.232143 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 185/383] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:01 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:01.437010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:01.437561 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:01.445227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.445707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.446134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.446823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.447270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.447694 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.576057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:01.584172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d468e2ef-7f80-478a-b2f8-1417da92d097 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.151115 Sep 22 12:32:01.584758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 199/384] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:01 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:01.612675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:01.613499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:01.619141 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.619625 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.620062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.620778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.621230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.621649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.635978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:01.748183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:01.756356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b3bbd7f-9dee-499b-b9ac-3b4a1c2b8136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.147516 Sep 22 12:32:01.756909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 186/385] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:01 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:01.876262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:01.876883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:01.883564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.884050 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.884532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:01.885230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:01.885685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:01.886119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.019594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.028463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.029893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.031030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cf589820-5601-47dc-a9c5-712b9d800695 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.158630 Sep 22 12:32:02.031580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 200/386] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:01 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:02.255677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:02.256237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:02.262637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.263116 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.263547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.264230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.264706 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.265130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.391203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.398879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae19281b-9c83-48bd-9e89-ffe69b24b2ba tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1505 microversion: 2.1 time: 0.147821 Sep 22 12:32:02.399436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 187/387] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:02 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:02.607158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:02.607830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:02.615462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.616085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.617284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.618161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.619022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.619484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.753445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.761325 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3c4f5184-7cb6-4c1e-a7d9-6090bd820632 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.158023 Sep 22 12:32:02.761885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 201/388] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:02 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:02.780423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:02.781082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:02.787542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.788023 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.788483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.789167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.789613 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.790029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.938682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:02.947359 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35d1cc98-9ba5-4bee-9548-9a0dbb6d2f23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.170967 Sep 22 12:32:02.947920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 188/389] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:02 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:02.949034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67d61f3-2119-4f47-80d4-7b702eefb87b", "name": "network-vif-deleted", "tag": "0f5cd551-a4b0-4894-b298-b24f7adf9e64"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:02.959417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:02.959889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:02.960333 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:02.976165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] Creating event network-vif-deleted:0f5cd551-a4b0-4894-b298-b24f7adf9e64 for instance a67d61f3-2119-4f47-80d4-7b702eefb87b on hv-cinder-85646 Sep 22 12:32:02.981860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e44a3a15-ceff-44c5-b586-b1727d76546a req-70035625-257c-463d-8d1d-fb1fb3dbfb13 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036906 Sep 22 12:32:02.982493 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 202/390] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:32:03.055557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:03.056074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:03.062027 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.062512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.062947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.063834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.064289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.064738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.198291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:03.207022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:03.208479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:03.209617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-106799ca-31ec-4c86-bdc8-bd00916ea072 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.158099 Sep 22 12:32:03.210228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 189/391] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:03 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:03.422389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:03.423095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:03.429463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.429957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.430405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.431127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.431582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.432006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.463020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.463517 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.463953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.464418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lazy-loading 'fault' on Instance uuid a67d61f3-2119-4f47-80d4-7b702eefb87b {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:32:03.505791 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d839834f5240dd91c5f7f615ffe36f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '543e3a7b5af24948a0ad0519d000e209', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:03.513458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3b8b19c4-af6f-4117-966c-3cc7c0fcb3ed tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 200 len: 1304 microversion: 2.1 time: 0.095331 Sep 22 12:32:03.514023 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 203/392] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:03 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:03.784117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:03.784827 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:03.791265 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.791753 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.792193 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.792917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.793374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.793802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.924749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:03.932483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-994a89a5-0a15-4db2-b77c-21ac78561b72 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.152205 Sep 22 12:32:03.933041 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 190/393] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:03 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:03.972031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:03.972693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:03.979386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.979871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.980318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.981017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:03.981474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:03.981899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:03.984615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:04.119041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:04.127750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-244907f3-6b7f-4f7a-9102-5ec96c4a482e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1702 microversion: 2.1 time: 0.159561 Sep 22 12:32:04.128519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 204/394] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:03 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1702 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:04.150017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:04.155894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.156407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.156841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.205478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d04cb8b-ca1a-46fa-995c-e2d41d452e06", "name": "network-vif-plugged", "status": "completed", "tag": "542f47ac-43dd-4d65-b99a-3389e7f5abdc"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:04.210012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=10 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:04.217137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.218185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.219303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.235153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] Creating event network-vif-plugged:542f47ac-43dd-4d65-b99a-3389e7f5abdc for instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 on hv-cinder-85646 Sep 22 12:32:04.241647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-74da1db8-93ef-49c9-9f30-6b3c55644d16 req-eec4fab3-a022-4631-8879-15beb42ec030 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039863 Sep 22 12:32:04.242289 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 205/395] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:32:04.244011 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 12:32:04.247594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:04.248356 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:04.268849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.269428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.269872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.270600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.271053 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.271476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.307400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-02921560-051e-4aed-9fa9-c3dcdfad6019 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action" status: 202 len: 0 microversion: 2.1 time: 0.160595 Sep 22 12:32:04.308318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 191/396] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:32:04 2022] POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:32:04.318346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:04.319588 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:04.338808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.339557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.339999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.341036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.341774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.342210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.540376 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:04.548714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:04.550274 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:04.551501 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a5883e89-568c-4744-89da-4c0d8b952411 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.308090 Sep 22 12:32:04.552062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 206/397] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:04 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:04.556476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:04.557089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] [instance: a67d61f3-2119-4f47-80d4-7b702eefb87b] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:04.563601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.567186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:04.569625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.570171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.572201 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.572641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.573074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.577860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abc7d80f-7353-489e-92af-5f62e18c5240 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1711 microversion: 2.1 time: 0.264656 Sep 22 12:32:04.578846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 192/398] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:04 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1711 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:04.605292 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] HTTP exception thrown: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Request method failure captured: Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b HTTP/1.1 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFWcC3n8FI7GLVJiqVGtfkEi594mUAXN-gTDg6PylWInWVi4lWDBbVDZL4QH6MOJaJJiqBOLK58S2GpXNsdXEhJRkodXptW5g4VYhff46-QQCXoXU_AhuZEn_xy1I85VE8JMq_EMSjnkx9dTfa80QsfVQrfn3HQPM1FMYW5UD3e7hwo Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 543e3a7b5af24948a0ad0519d000e209 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesActionsTest-963501249 Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:32:04.606950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/543e3a7b5af24948a0ad0519d000e209"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_543e3a7b5af24948a0ad0519d000e209"}]}] Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesActionsTest-963501249 Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 543e3a7b5af24948a0ad0519d000e209 Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesActionsTest-963501249 Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesActionsTest-963501249-project Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 70d839834f5240dd91c5f7f615ffe36f Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesActionsTest-963501249-project Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. Sep 22 12:32:04.608218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'a67d61f3-2119-4f47-80d4-7b702eefb87b'} Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:32:04.609695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. Sep 22 12:32:04.610831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:32:04.611896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] Returning 404 to user: Instance a67d61f3-2119-4f47-80d4-7b702eefb87b could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:32:04.611896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c513ff90-4c03-4544-9d88-613014c79833 tempest-VolumesActionsTest-963501249 tempest-VolumesActionsTest-963501249-project] 10.222.0.33 "GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b" status: 404 len: 111 microversion: 2.1 time: 0.055355 Sep 22 12:32:04.611896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 207/399] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:04 2022] GET /compute/v2.1/servers/a67d61f3-2119-4f47-80d4-7b702eefb87b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:32:04.956330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:04.957052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:04.963820 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.964244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.964713 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:04.965412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:04.965863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:04.966293 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:05.110139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:05.117989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e943bdb4-38a6-4d92-bc36-efac79608a84 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.166411 Sep 22 12:32:05.118733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 193/400] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:04 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:05.577905 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:05.578554 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:05.585410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:05.585879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:05.586415 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:05.587156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:05.587599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:05.588009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:05.601802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:05.602672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:05.610132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:05.610718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:05.612322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:05.613047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:05.613635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:05.614065 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:05.791744 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:05.798295 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:05.800835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:05.802295 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:05.803461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-548810f4-9926-4292-ab70-a64a9d80e5be tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.229579 Sep 22 12:32:05.804002 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 208/401] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:05 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:05.807451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e18d9758-f8d1-489b-b1a7-7bdd8d868c50 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1711 microversion: 2.1 time: 0.209409 Sep 22 12:32:05.808094 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 194/402] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:05 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1711 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:06.141290 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:06.142168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:06.149128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.149612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.150044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:06.150729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.151182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.151604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:06.277610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:06.286005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7f6b229c-f57f-4f78-bc78-878caa27f1fe tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.148635 Sep 22 12:32:06.286584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 209/403] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:06 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:06.828446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:06.829058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:06.830848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:06.831461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:06.836114 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.836631 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.837065 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:06.837757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.838026 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.838210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.838547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.838662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:06.838985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:06.839715 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:06.840171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:06.840634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:07.031280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:07.035257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:07.039669 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e0d51e8a-3cef-4c19-89c5-593af7af8a01 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1711 microversion: 2.1 time: 0.213136 Sep 22 12:32:07.040232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 210/404] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:06 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1711 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:32:07.043198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:07.044961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:07.046113 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-338b5c09-55c8-46d5-8426-a181724ef0c6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.221650 Sep 22 12:32:07.046653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 195/405] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:06 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:07.307857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:07.308459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:07.314391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:07.315383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:07.315811 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:07.316522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:07.316969 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:07.317390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:07.446065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:07.453779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b1d5e397-a5f5-4c11-b6fd-31ed633c3eee tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.149849 Sep 22 12:32:07.454337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 211/406] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:07 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:08.063268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:08.063913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:08.070536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.071024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.071432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:08.071823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.072375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.072484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:08.072830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.073283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.078703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.079189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.079766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.080500 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.080960 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.081390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.274260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:08.277238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:08.282601 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74bcd6bd-2045-49fc-bddd-ed01c05711b8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1711 microversion: 2.1 time: 0.223181 Sep 22 12:32:08.283171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 196/407] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:08 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1711 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:08.285956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:08.287413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:08.288670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c9c840c6-b08a-4956-a109-42d31e24df88 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.221475 Sep 22 12:32:08.289203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 212/408] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:08 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:32:08.477847 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:08.478461 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:08.484463 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.484949 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.485384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.486069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:08.486550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:08.486975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:08.614614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:08.623147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1e9d5766-b596-42de-8e3d-7e4cffffbea1 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1318 microversion: 2.1 time: 0.149613 Sep 22 12:32:08.623718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 197/409] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:08 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:09.306919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:09.307435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:09.313506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:09.313990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.314192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:09.314400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.316111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.317044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.317515 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.317945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.322278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.322778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.323214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.323925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.324412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.324838 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.525274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:09.527806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:09.534800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:09.536566 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:09.537726 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7ec5592-fca9-4eb6-9a97-398e038f246a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.228199 Sep 22 12:32:09.538468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 198/410] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:09 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:09.538670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-21d03499-a908-4eea-9489-c1b2981ac972 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1711 microversion: 2.1 time: 0.235844 Sep 22 12:32:09.539811 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 213/411] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:09 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1711 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:09.648546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:09.649243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:09.655256 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.655754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.656320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.657069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:09.657649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:09.658075 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:09.821943 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:09.832986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abcf466c-b0a2-4d83-a47a-8ad16eb38147 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1508 microversion: 2.1 time: 0.190476 Sep 22 12:32:09.833705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 199/412] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:09 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:10.567533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:10.568932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:10.570113 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:10.570884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:10.581167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:10.584552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:10.585112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:10.585821 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:10.586262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:10.586743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:10.587527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:10.587985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:10.588440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:10.592997 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:10.593462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:10.593892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:10.835707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:10.840134 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:10.849617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70a29d63-b0cd-4196-bd1c-4eb7218c55dd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1715 microversion: 2.1 time: 0.285735 Sep 22 12:32:10.850677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 200/413] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:32:10 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1715 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:32:10.854582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:10.856359 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:10.857819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-10dba16c-7359-488a-b84b-2a085001c7e5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.298596 Sep 22 12:32:10.872607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 214/414] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:10 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:11.885205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:11.886893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:11.894515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:11.895171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:11.895677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:11.896533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:11.897091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:11.897518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:12.038850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:12.047656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:12.049144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:12.050318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-11f00e0a-9bd4-4f13-b504-866da65f6f12 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.169966 Sep 22 12:32:12.050866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 201/415] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:11 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:13.075046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:13.075700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:13.082785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:13.083265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:13.083699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:13.084423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:13.084880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:13.085301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:13.223098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:13.231818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:13.233281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:13.234416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-75a969a3-96df-4ea1-9b98-24eb29756357 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.163281 Sep 22 12:32:13.235097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 215/416] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:13 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:14.261809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:14.272323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:14.272323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:14.272593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:14.273518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:14.274227 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:14.274677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:14.275336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:14.278624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:14.468165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:14.482399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:14.483856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:14.485076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68ead13c-3414-4f60-9e16-fdf5519386f8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.228402 Sep 22 12:32:14.485834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 202/417] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:14 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:15.515020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:15.515588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:15.523683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:15.524416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:15.525019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:15.525724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:15.526204 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:15.526633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:15.665361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:15.675453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:15.676938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:15.678106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6c007657-bbd6-4aaf-8222-5e1435b89965 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.167030 Sep 22 12:32:15.678648 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 216/418] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:15 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:16.703393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:16.703995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:16.712439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:16.712928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:16.713366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:16.714210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:16.714663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:16.715084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:16.881996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:16.890964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:16.892693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:16.893989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f919b31f-2493-4c08-a7fb-e25c9751963e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.194705 Sep 22 12:32:16.894646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 203/419] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:16 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:17.919924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:17.920731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:17.929802 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:17.930264 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:17.931055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:17.932108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:17.932495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:17.933366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:17.940671 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:18.077982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:18.086728 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:18.088153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:18.089336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-314a336e-e442-4869-a42b-c4b11bd68825 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.173342 Sep 22 12:32:18.089881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 217/420] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:17 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:19.125450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:19.126196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:19.138498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:19.139188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:19.153856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:19.155904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:19.164117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:19.165045 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:19.346011 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:19.355203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:19.356717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:19.357885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48bdfd99-d199-4a27-bd9b-1668b00618c8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.236495 Sep 22 12:32:19.358442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 204/421] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:19 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:20.383121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:20.383843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:20.390349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:20.390822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:20.391496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:20.392252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:20.392819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:20.393457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:20.533744 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:20.545228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:20.547464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:20.548963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f2408885-e0ae-4f9c-b590-87fd13ca4c56 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.169862 Sep 22 12:32:20.549519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 218/422] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:20 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:32:21.575035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:21.575743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:21.582268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:21.582761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:21.583211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:21.584532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:21.584984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:21.585407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:21.720985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:21.730767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:21.733224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:21.734776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-75c883de-2e47-48b7-a1e7-036b6f7eba32 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.163631 Sep 22 12:32:21.735794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 205/423] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:21 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:22.763449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:22.764164 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:22.772109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:22.773755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:22.774487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:22.775664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:22.776321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:22.776704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:22.934707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:22.945033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:22.946647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:22.948027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ee340419-a24e-46fa-90ea-baf9b08bfd48 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.189062 Sep 22 12:32:22.949065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 219/424] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:22 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:23.977975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:23.978826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:23.987314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:23.987809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:23.988435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:23.989184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:23.990333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:23.990748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:24.170361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:24.185175 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:24.190548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:24.192337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fe3ef1cb-b65c-4ca8-8bbf-8ae5e1557859 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1745 microversion: 2.20 time: 0.221978 Sep 22 12:32:24.194922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 206/425] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:23 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:25.224573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:25.225003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:25.228322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:25.232675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:25.233149 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:25.233610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:25.234312 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:25.234766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:25.235189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:25.371642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:25.380104 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:25.381857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:25.382876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-66b52000-09c0-4703-8d6a-2577db8fd5c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1745 microversion: 2.20 time: 0.163700 Sep 22 12:32:25.383615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 220/426] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:25 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:26.204407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "name": "network-vif-plugged", "status": "completed", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:26.211438 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=66 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:26.220329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:26.221133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:26.221870 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:26.236809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] Creating event network-vif-plugged:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:32:26.242645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f282771f-1960-4f5f-b112-369c379e5df2 req-5c40f25d-8a46-49f6-9697-52d7ca8a92fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042184 Sep 22 12:32:26.245528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 207/427] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:32:26.409352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:26.410123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:26.417542 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:26.418028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:26.418732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:26.419488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:26.420115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:26.420571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:26.574497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:26.583093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:26.585066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:26.586516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9151ce17-62ee-4685-920b-b2282b2afa27 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.181149 Sep 22 12:32:26.587334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 221/428] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:26 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:32:27.614198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:27.615317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:27.621995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:27.622532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:27.622989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:27.623792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:27.624257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:27.624708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:27.764198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:27.772775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:27.774508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:27.775771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-164dcc37-b6b4-40d6-8276-15bc778b6aa8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.166505 Sep 22 12:32:27.776533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 208/429] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:27 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:28.801298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:28.802595 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:28.810772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:28.811276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:28.811954 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:28.812897 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:28.813524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:28.813978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:28.994313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:29.012157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:29.014180 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:29.015814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1d4acfbf-60ff-4ce2-b66c-da9a92ec5da4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.218468 Sep 22 12:32:29.020330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 222/430] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:28 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:30.045917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:30.047353 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:30.067550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:30.068480 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:30.069179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:30.070164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:30.070907 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:30.071571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:30.368362 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:30.379660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:30.383771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:30.395849 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14615df3-0754-4898-b90c-aa71ed3c63b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.353563 Sep 22 12:32:30.397192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 209/431] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:30 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:31.422873 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:31.423647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:31.448096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:31.449050 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:31.449763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:31.450775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:31.451551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:31.452115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:31.678496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:31.691551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:31.693674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:31.694876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d12b424e-9828-413a-8d99-c39ca2767589 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.277030 Sep 22 12:32:31.696881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 223/432] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:31 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:32.744233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:32.746172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:32.762942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:32.764429 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:32.766956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:32.767879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:32.769538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:32.770258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:33.006217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:33.023797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:33.026928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:33.028693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a8dba4ec-96ee-4e23-a1fe-2bba05a9dc00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.311959 Sep 22 12:32:33.040758 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 210/433] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:32 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:34.058928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:34.060340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:34.069419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:34.070198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:34.070656 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:34.071533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:34.072146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:34.072920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:34.231686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:34.240579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:34.242034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:34.243257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-79b94139-a0bd-4b33-9fce-b4c6b5f508d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.191305 Sep 22 12:32:34.244162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 224/434] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:34 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:35.291862 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:35.294078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:35.303018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:35.303508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:35.303950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:35.304709 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:35.305166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:35.305593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:35.481669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:35.494523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:35.496073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:35.497828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e37b8469-4346-4f08-84e9-60e2b24e7149 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.220889 Sep 22 12:32:35.499191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 211/435] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:35 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:36.526828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:36.527525 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:36.534245 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:36.534985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:36.535495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:36.536345 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:36.537009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:36.537513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:36.681609 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:36.691554 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:36.693250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:36.694605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4278c00f-7059-415f-be5a-10c224710916 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.172396 Sep 22 12:32:36.695175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 225/436] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:36 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:37.721762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:37.723007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:37.733088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:37.733836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:37.734434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:37.735298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:37.736190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:37.736808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:37.889648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:37.898367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:37.899813 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:37.901883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6c3894ff-da81-4881-8129-a1347b1583c4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.184719 Sep 22 12:32:37.903017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 212/437] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:37 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:38.932439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:38.933652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:38.942418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:38.943143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:38.943943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:38.944822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:38.945987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:38.946703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:39.101051 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:39.110169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:39.111717 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:39.112993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9c1d2689-fd39-4c41-a0d8-25ba370b6a0e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1740 microversion: 2.20 time: 0.187430 Sep 22 12:32:39.113548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 226/438] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:38 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:39.270635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b13e3e6-c9e8-4219-ba0a-13009f997eef", "device": "/dev/sdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:39.273753 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:39.279983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:39.280559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:39.281050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:39.281807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:39.282319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:39.282805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:39.735638 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b1e1e93-da87-4281-a1bc-e3655852e705 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "POST /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468785 Sep 22 12:32:39.736472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 213/439] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:32:39 2022] POST /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:32:40.140322 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:40.140893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:40.147526 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:40.148010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:40.148661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:40.149372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:40.149837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:40.150259 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:40.286363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:40.295158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:40.296671 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:40.297812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2c03160e-e034-4226-be17-acb61ab4d9ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1722 microversion: 2.20 time: 0.161566 Sep 22 12:32:40.298363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 227/440] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:40 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:41.325198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:41.325891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:41.332434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:41.332911 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:41.333340 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:41.334046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:41.334467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:41.334884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:41.680242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:41.688133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:41.689587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:41.690722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e21cd5ac-c82c-4bb8-8c23-b7b8f56c0a70 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1722 microversion: 2.20 time: 0.370863 Sep 22 12:32:41.691272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 214/441] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:41 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:42.551861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01c995da-16ff-4ad9-afbc-13870713ca2e"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:42.554310 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:42.561351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:42.561827 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:42.562262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:42.562952 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:42.564019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:42.564483 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:42.672246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "name": "network-vif-unplugged", "status": "completed", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:42.684275 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:42.684793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:42.685583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:42.696642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] Creating event network-vif-unplugged:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:32:42.701688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b80fb380-2c14-415a-9044-5af04a97bd7b req-906d03ce-b1c9-4e27-aa12-225a416a3fa2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033103 Sep 22 12:32:42.702456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 215/442] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:32:42.716495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:42.717283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:42.723372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:42.723859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:42.724339 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:42.725037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:42.725491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:42.725961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:42.855606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:42.863761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:42.865268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:42.866424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2554f19-ec02-4f91-bd97-e253c036f2b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1722 microversion: 2.20 time: 0.153979 Sep 22 12:32:42.866976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 216/443] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:42 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:32:43.788171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-04ab7c63-bd9b-4fe1-bce0-bc82ed1c1777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.240073 Sep 22 12:32:43.789069 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 228/444] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:32:42 2022] POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:32:43.890961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:43.891810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:43.899559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:43.900051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:43.900520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:43.901224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:43.901675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:43.902099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.040897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.049144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.050442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.051585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-18633caa-7652-4476-9535-c39a9af37051 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1725 microversion: 2.20 time: 0.164536 Sep 22 12:32:44.052269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 217/445] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:43 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:44.077965 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03b3a237-c5e9-4957-809b-009128186b05"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:44.080592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:44.087330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.087823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.088264 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.088996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.089452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.089881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.363699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:44.371951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-74598df4-faa7-4da9-9fe6-9279cd763e8c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298875 Sep 22 12:32:44.372594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 229/446] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Sep 22 12:32:44 2022] POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:32:44.494992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:32:44.495584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:44.501460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.501942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.502371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.503049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.503495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.503910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.506338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:44.553365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 12:32:44.622646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff7e4b85-3a70-4908-86a2-c90ae527d41f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/action" status: 202 len: 0 microversion: 2.20 time: 0.132010 Sep 22 12:32:44.623336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 218/447] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 22 12:32:44 2022] POST /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:32:44.633288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:44.633893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:44.642126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.642502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.642982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.643809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:44.644330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:44.644792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:44.799006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.809300 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.812094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:44.813759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-452569df-8b0d-480a-b1df-988996c75cf4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1751 microversion: 2.20 time: 0.184619 Sep 22 12:32:44.814682 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 230/448] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:44 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:45.844361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:45.844965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:45.852615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:45.853097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:45.853526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:45.854203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:45.854717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:45.855051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:45.995029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:46.003518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:46.004986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:46.006137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c4ddda4-4fbb-47b4-92c0-cdfd4e871f43 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1751 microversion: 2.20 time: 0.166387 Sep 22 12:32:46.006679 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 219/449] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:45 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:47.033789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:47.034252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:47.041222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:47.041819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:47.042320 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:47.043017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:47.044055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:47.045063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:47.174161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:47.183824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:47.185368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:47.186506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-666de1e0-b634-46f2-917c-01469aa9d4ee tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1751 microversion: 2.20 time: 0.156914 Sep 22 12:32:47.187083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 231/450] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:47 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:48.211642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:48.212287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:48.219627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:48.220112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:48.220575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:48.221268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:48.221720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:48.222145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:48.348339 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:48.357107 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:48.358543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:48.359698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8da31337-a22b-4fcb-b452-3da97bd35669 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1751 microversion: 2.20 time: 0.152056 Sep 22 12:32:48.360315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 220/451] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:48 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1751 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:49.385614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:49.386326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:49.394973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:49.395464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:49.395904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:49.396639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:49.397146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:49.397509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:49.533442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:49.551781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:49.553588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:49.554748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e4e8b157-3c72-4548-8f87-94d43965989c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.173718 Sep 22 12:32:49.564591 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 232/452] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:49 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:50.582999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:50.583605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:50.590705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:50.591184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:50.591614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:50.592319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:50.592773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:50.593193 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:50.716529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:50.724969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:50.726405 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:50.728319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ea46aae-34bf-4e24-9cea-cba7c323fd9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.148458 Sep 22 12:32:50.728865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 221/453] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:50 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:51.754158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:51.754839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:51.761932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:51.762412 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:51.762852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:51.763540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:51.763993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:51.764457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:51.907232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:51.916258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:51.917734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:51.918880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e10f9f7e-bff0-49fa-a996-fcea886f33ba tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.168612 Sep 22 12:32:51.919440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 233/454] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:51 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:52.944792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:52.945323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:52.952272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:52.952785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:52.953219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:52.953906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:52.954360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:52.954783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:53.081516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:53.090029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:53.091459 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:53.092709 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae112602-7de2-4838-8fd0-5d73fa61924d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.151750 Sep 22 12:32:53.093259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 222/455] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:52 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:54.117551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:54.118666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:54.125121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:54.125606 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:54.126043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:54.126736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:54.127190 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:54.127616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:54.257408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:54.267317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:54.269034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:54.270415 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bbcfc9c4-c1ad-4a40-bdb7-587e450ae46c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.156473 Sep 22 12:32:54.271410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 234/456] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:54 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:55.297595 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:55.298206 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:55.304634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:55.305115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:55.306066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:55.307018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:55.307473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:55.307894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:55.440027 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:55.449099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:55.450516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:55.451652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0dc87ee6-df7c-4e78-b912-08187b8bb003 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.158009 Sep 22 12:32:55.452198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 223/457] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:55 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:56.477639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:56.478270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:56.480574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=30 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:56.485922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:56.486396 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:56.486835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:56.487497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:56.487941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:56.488386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:56.614192 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:56.623253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:56.624734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:56.625881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-933bc9c0-552a-46c0-bd27-c54183c5ffb2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.152509 Sep 22 12:32:56.626428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 235/458] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:56 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:57.651971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:57.652607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:57.654892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:32:57.660277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:57.660817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:57.661257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:57.661950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:57.662406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:57.662834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:57.791642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:57.800083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:57.801549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:57.802692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3fc325f5-f7f9-4ff9-bb22-5556b4d1aab3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.155072 Sep 22 12:32:57.803247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 224/459] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:57 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:32:58.827454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:32:58.828060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:32:58.834690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:58.835168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:58.835598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:58.836281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:32:58.836759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:32:58.837179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:32:58.965314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:58.974070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:58.975508 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:32:58.976684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-98f6adfd-54f0-4a96-896b-86d38c771715 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.153081 Sep 22 12:32:58.977242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 236/460] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:58 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:00.002988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:00.003633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:00.010406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.010886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.011323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.012016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.012516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.012944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.159648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:00.168523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:00.169963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:00.171290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-790fd578-9073-4165-b377-921c67042771 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.172153 Sep 22 12:33:00.171791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 225/461] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:32:59 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:00.365019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:00.365594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:00.371910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.372439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.372883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.373575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.374030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.374454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.397368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dce9b52a-28f6-4c5b-8bad-c0c72f7ef013 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/ips" status: 200 len: 150 microversion: 2.1 time: 0.036339 Sep 22 12:33:00.397925 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 237/462] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:33:00 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:00.410481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "610b4fcf-09f2-475f-b9df-7a2a9fce13c0"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:00.412966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:00.418972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.419457 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.419895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.420614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.421074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.421497 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.501539 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/os-volume_attachments HTTP/1.1 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 74 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:33:00.503455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "610b4fcf-09f2-475f-b9df-7a2a9fce13c0"}} Sep 22 12:33:00.505070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'server_id': 'd298c197-bf2c-41e0-a0d0-f0f48e979904', 'body': {'volumeAttachment': {'volumeId': '610b4fcf-09f2-475f-b9df-7a2a9fce13c0'}}} Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:00.506067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:00.507532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 400 to user: Invalid volume: volume 610b4fcf-09f2-475f-b9df-7a2a9fce13c0 is already attached to instances: 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-caf67b78-9f6b-4c57-b5fa-a3536f120466 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098443 Sep 22 12:33:00.508979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 226/463] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:33:00 2022] POST /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:33:00.514475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:00.514979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:00.520884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.521369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.521804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.522492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.522943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.523366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.547354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:33:00.622168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5863a2d1-bacc-4d21-8a4f-58c65e416ca9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 204 len: 0 microversion: 2.1 time: 0.111065 Sep 22 12:33:00.622967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 238/464] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:33:00 2022] DELETE /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:33:00.631596 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:00.632230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:00.639584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.640063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.640536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.641213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:00.641659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:00.642078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:00.767915 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:00.775568 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-599f5f1d-1185-4721-80d4-05b2ecbc9807 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1680 microversion: 2.1 time: 0.147900 Sep 22 12:33:00.776207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 227/465] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:00 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:01.198431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:01.199129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:01.205063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:01.205539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:01.205973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:01.206657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:01.207107 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:01.207527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:01.338512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:01.347311 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:01.349389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:01.350547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-25761ea7-8dd4-4e56-ba18-9f92087acf07 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.156992 Sep 22 12:33:01.351638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 239/466] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:01 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:01.799078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:01.799711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:01.806775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:01.807257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:01.807694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:01.808406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:01.808858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:01.809276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:01.939579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:01.947215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2e38c12f-d0d9-42e0-8a18-6d3460200cba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1680 microversion: 2.1 time: 0.151962 Sep 22 12:33:01.947766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 228/467] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:01 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:02.376433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:02.376975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:02.383765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:02.384775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:02.385206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:02.385882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:02.386342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:02.386746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:02.514585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:02.525450 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:02.526896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:02.528124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2afbc965-ebd4-4975-936b-01525a5c0158 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.155566 Sep 22 12:33:02.528704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 240/468] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:02 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:02.969962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:02.970580 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:02.976991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:02.977748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:02.978213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:02.978953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:02.979410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:02.979844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:03.112272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:03.120654 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b33c2332-50b2-44b9-b798-c8953235b31d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1680 microversion: 2.1 time: 0.154487 Sep 22 12:33:03.121266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 229/469] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:02 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:03.553129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:03.553727 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:03.560156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:03.560670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:03.561102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:03.561790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:03.562240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:03.562659 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:03.691622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:03.700171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:03.701645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:03.702789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-433c97af-dae0-4f68-976c-b956d4271a35 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.153541 Sep 22 12:33:03.703335 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 241/470] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:03 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:04.143530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:04.144147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:04.151239 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:04.151720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:04.152157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:04.152877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:04.153332 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:04.153757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:04.281694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:04.289282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96ab1eea-2c66-4063-8ad2-2b0955a87321 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1680 microversion: 2.1 time: 0.149617 Sep 22 12:33:04.289844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 230/471] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:04 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:04.729296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:04.729932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:04.736244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:04.736751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:04.737178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:04.738048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:04.738499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:04.738916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:04.875139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:04.883909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:04.885421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:04.886575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f0f5a1f1-ee7f-4ead-9bfa-ae27111245e6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.161989 Sep 22 12:33:04.887126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 242/472] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:04 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:05.313097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:05.313754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:05.320733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:05.321234 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:05.321708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:05.322425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:05.322879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:05.323307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:05.472998 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:05.481754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3782dcf9-0bee-4cf5-b5c9-985c011c37fd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1680 microversion: 2.1 time: 0.173024 Sep 22 12:33:05.482624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 231/473] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:05 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:05.911580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:05.912377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:05.918880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:05.919321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:05.919752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:05.920492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:05.920949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:05.921388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.050074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:06.059650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:06.061501 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:06.062835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-766739e9-f001-4dd5-ab55-e08fba933df3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1753 microversion: 2.20 time: 0.155264 Sep 22 12:33:06.063460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 243/474] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:05 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:06.183276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:06.185585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:06.191506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.191995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.192477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.193174 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.193628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.194051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.217150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'flavor' on Instance uuid 4881b40d-864a-42ec-8c64-a1366dac5f05 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:06.322863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:06.362081 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa5d7edc-2866-4053-a2ab-04d9aa929371 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/action" status: 200 len: 32 microversion: 2.1 time: 0.183103 Sep 22 12:33:06.363238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 232/475] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:33:06 2022] POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:33:06.387009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:06.387715 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:06.393983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.394721 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.395354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.396265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.396917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.397349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.512881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:06.512881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:06.513700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.514431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.515125 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.516109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.516578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.517115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.664244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:06.677635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ca68ab83-1bcb-4656-af0a-5ea8cd78e055 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1613 microversion: 2.1 time: 0.176351 Sep 22 12:33:06.678944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 233/476] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:06 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1613 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:06.714317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:06.723531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28e3a151-5465-4967-9166-1b75b8adb800 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.353180 Sep 22 12:33:06.750181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d298c197-bf2c-41e0-a0d0-f0f48e979904", "name": "network-vif-deleted", "tag": "3de3f767-ed67-4ebd-ad2d-e94ea3db7b53"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:06.760594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 244/477] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:06 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:06.777074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:06.777577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:06.777990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:06.797384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] Creating event network-vif-deleted:3de3f767-ed67-4ebd-ad2d-e94ea3db7b53 for instance d298c197-bf2c-41e0-a0d0-f0f48e979904 on hv-cinder-85646 Sep 22 12:33:06.802782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-f3788543-44b7-4827-9909-9d237e9b2789 req-8f35a3e7-28fd-403b-abd8-e7baf26dd415 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056627 Sep 22 12:33:06.803736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 234/478] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:07.090034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:07.091392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:07.098212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.098992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.099431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.100141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.100627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.101062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.104200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:07.245377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:07.255262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:07.257088 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:07.258418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-55833b74-3db0-4aad-a7ec-d3509f742f9d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.173319 Sep 22 12:33:07.258965 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 245/479] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:07 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:07.701852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:07.702701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:07.709716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.710260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.711146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.712006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.712526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.712951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.748546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.749297 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.751015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.751015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid d298c197-bf2c-41e0-a0d0-f0f48e979904 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:07.756110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:07.757467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:07.763773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.764609 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.765303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.766075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.766607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.767109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.826957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:07.835182 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e665e38c-e5e8-449e-9076-379a51303c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 200 len: 1330 microversion: 2.1 time: 0.137826 Sep 22 12:33:07.835760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 235/480] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:07 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:07.842171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:07.843145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:07.849438 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.850122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.850745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.851616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:07.852246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:07.853755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:07.942761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:07.951750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c0adcf51-34c7-4979-9029-8d29ed8094b3 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.199367 Sep 22 12:33:07.964901 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 246/481] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:07 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:08.043180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'services' on Instance uuid 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:08.195240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-14f45995-da2f-4a0a-ba01-a68f777605db tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06/os-volume_attachments/9b13e3e6-c9e8-4219-ba0a-13009f997eef" status: 202 len: 0 microversion: 2.1 time: 0.357949 Sep 22 12:33:08.195910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 236/482] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:33:07 2022] DELETE /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06/os-volume_attachments/9b13e3e6-c9e8-4219-ba0a-13009f997eef => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:08.285824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:08.286464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:08.293224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.293707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.294138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:08.294824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.295511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.295671 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:08.426135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:08.435342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:08.436813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:08.437955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28d5a3c4-fca2-4325-870f-9b36f51c6a91 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.156068 Sep 22 12:33:08.438576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 247/483] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:08 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:08.861778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:08.863255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:08.870056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.870536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.871030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:08.871751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.872226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.872677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:08.886879 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 HTTP/1.1 Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:33:08.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:33:08.890009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'd298c197-bf2c-41e0-a0d0-f0f48e979904'} Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:33:08.890893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:33:08.892249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:08.894229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:33:08.894229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0245e053-ef74-487d-a646-fe509ce9a167 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 404 len: 111 microversion: 2.1 time: 0.033688 Sep 22 12:33:08.894229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 237/484] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:08 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:33:08.898817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f588dffc-fe27-4c5f-ae42-49723953fba7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '.version_select at 0x7f1079c331f0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:08.920319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f588dffc-fe27-4c5f-ae42-49723953fba7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217052524" status: 202 len: 0 microversion: 2.1 time: 0.025121 Sep 22 12:33:08.920929 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 248/485] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 22 12:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217052524 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:08.977215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:08.979790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:08.986550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.987032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.987646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:08.988580 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:08.989100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:08.990117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:09.229697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:09.238213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fd9842cd-3488-4158-aa6d-ba83484a15b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.265177 Sep 22 12:33:09.238914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 238/486] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:08 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:09.464409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:09.465024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:09.472155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:09.472670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:09.473105 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:09.473803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:09.474254 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:09.474675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:09.678520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:09.693119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:09.694915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:09.696255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9e44b43c-6984-407d-a787-35dc8f3ec3f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.237270 Sep 22 12:33:09.698293 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 249/487] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:09 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:09.867593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:09.874149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:09.881886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:09.882630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:09.883074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:09.883779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:09.884507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:09.885129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:09.987281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'services' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:10.075243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-48bda9ad-971e-40fd-92b8-97e0179ae4d7 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments/610b4fcf-09f2-475f-b9df-7a2a9fce13c0" status: 202 len: 0 microversion: 2.1 time: 0.219121 Sep 22 12:33:10.075828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 239/488] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:33:09 2022] DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments/610b4fcf-09f2-475f-b9df-7a2a9fce13c0 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:10.085060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:10.087984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:10.096082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.096766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.097373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.098405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.099172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.100255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.134080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ddb9f9b6-60b3-4617-b386-b58d45e740c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053548 Sep 22 12:33:10.134546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 250/489] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:10 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:10.262591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:10.263293 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:10.269401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.269883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.270318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.271001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.271456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.271878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.396752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:10.397214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:10.404461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.405370 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.406089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.407188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.407675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.408102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.432201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:10.436700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:33:10.451687 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-930b7f8f-a875-488b-9448-7cf6a33893fa tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.193264 Sep 22 12:33:10.452443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 240/490] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:10 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:10.527666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8fb4dc51-c826-4359-ad9b-c35ba77858bd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 204 len: 0 microversion: 2.1 time: 0.134790 Sep 22 12:33:10.528395 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 251/491] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:33:10 2022] DELETE /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 12:33:10.538999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:10.539889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:10.547414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.547897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.548366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.549068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.549521 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.549945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.686117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:10.694246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f7c0c29b-7f10-4561-bb75-ad53023895fa tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.161582 Sep 22 12:33:10.694841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 241/492] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:10 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:10.723419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:10.724116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:10.730512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.731006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.731516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.732208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:10.732641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:10.733071 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:10.885328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:10.895502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:10.897319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:10.898649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-41554ca4-25a8-4d37-bb5c-da04dd76c0b2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.179398 Sep 22 12:33:10.899296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 252/493] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:10 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:11.146886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:11.149148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:11.155563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.156028 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.156493 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.157184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.157643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.158063 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.187765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5fd3111-4643-4f89-b7c6-6d87bf180887 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Sep 22 12:33:11.188317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 242/494] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:11 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:11.475255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:11.475783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:11.483060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.483544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.483989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.484706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.485159 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.485580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.620221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:11.629147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f87a96b-c651-4e08-9939-c65abc318482 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.157783 Sep 22 12:33:11.629699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 253/495] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:11 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:11.718324 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:11.719055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:11.725121 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.725662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.726049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.726742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.727197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.728430 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.855901 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:11.870448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-002879ce-df6d-452c-b6ca-4943ba39de63 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.155960 Sep 22 12:33:11.871609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 243/496] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:11 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:11.924916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:11.925563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:11.931703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.932177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.932633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:11.933347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:11.933795 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:11.934222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.069686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:12.078264 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:12.079677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:12.080843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a9b8c095-06dd-4fd4-993a-42b66f666745 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.160036 Sep 22 12:33:12.081389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 254/497] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:11 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:12.201016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:12.204157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:12.211002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.211482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.211921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.213301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.213747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.214173 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.243373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c59862c7-4133-479f-ba0b-bad25a8c11b1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 Sep 22 12:33:12.244197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 244/498] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:12 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:12.652076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:12.653360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:12.659941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.660465 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.660904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.661602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.662053 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.662473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.807357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:12.817562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8c55f54d-710e-4a2d-bcf9-d4537da4afd0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.169215 Sep 22 12:33:12.818146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 255/499] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:12 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:12.904739 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:12.905379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:12.912491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.913258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.913927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:12.914851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:12.916010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:12.916991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.061804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:13.070015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-49ee948b-cc2c-4b6f-b598-5629a84b57a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.169750 Sep 22 12:33:13.070579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 245/500] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:12 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:13.108182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:13.109040 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:13.115527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.116244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.116776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.117547 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.118082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.119337 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.256187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:13.258349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:13.262135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:13.265014 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.265536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.265976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.266684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.267138 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.267561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.270912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:13.272381 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:13.273537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-32c8124c-06ac-4dcb-a7fc-665b77f4f082 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.169683 Sep 22 12:33:13.274081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 256/501] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:13 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:13.303327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3440af09-e26c-4e54-a054-782b760016ec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051126 Sep 22 12:33:13.304349 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 246/502] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:13 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:13.841256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:13.841864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:13.848266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.848854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.849288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.849970 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:13.850419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:13.850842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:13.983809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:13.992853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0bad719c-f07c-4aa9-87dc-03cc433aef98 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.155280 Sep 22 12:33:14.004332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 257/503] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:13 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:14.093515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:14.094044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:14.100334 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.101089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.101449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.102140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.103440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.103871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.238496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:14.246720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0e526e2-b3d3-4754-86b2-4c2abfe57e97 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.157220 Sep 22 12:33:14.247276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 247/504] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:14 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:14.303993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:14.304864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:14.314571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.315209 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.315722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.316581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.316909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:14.317435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.317765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.319044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:14.325462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.325944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.326378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.327069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:14.327519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:14.327940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:14.330522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:14.363954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-50b67609-13e3-4307-926e-63419982ed23 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050902 Sep 22 12:33:14.364473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 248/505] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:14 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:14.455446 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:14.465052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:14.466509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:14.467686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-557988b7-5c16-47e7-bfad-039957b9b448 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.169628 Sep 22 12:33:14.468237 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 258/506] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:14 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:15.018515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:15.019159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:15.025668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.026149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.026604 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.027289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.027738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.028161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.169778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:15.178021 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12cb07e5-c611-42a1-89f2-1b42e7f052b0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.163521 Sep 22 12:33:15.178580 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 249/507] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:15 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:15.269838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:15.270637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:15.278876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.279470 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.279973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.280787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.281312 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.281823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.376658 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:15.379052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:15.386957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.387531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.388059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.388856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.389378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.390032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.426630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-24597423-8355-4a9f-ba6d-1f8647559c21 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053854 Sep 22 12:33:15.427204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 250/508] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:15 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:15.438302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:15.447153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3c1cbc0a-a9ee-4c44-8c07-e8e0ef503b7f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.180914 Sep 22 12:33:15.447709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 259/509] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:15 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:15.496430 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:15.497409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:15.503926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.504496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.504977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.505671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.506122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.506544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.642887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:15.651511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:15.653042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:15.654195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7bf6e60-718a-41b6-9a9b-5da09b82d5f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.163939 Sep 22 12:33:15.654750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 251/510] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:15 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:15.982159 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:15.982655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:15.989098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.989444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.989894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:15.990641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:15.991124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:15.991570 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.119970 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lazy-loading 'services' on Instance uuid 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:16.155492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:16.201252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:16.201868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:16.207906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.208677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.209112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.209796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.210243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.210660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.256571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0a18e2b7-80bd-471d-ad5b-494304fa7583 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments/830e5da3-6a66-4fc3-9b46-f4fbabf155c1" status: 202 len: 0 microversion: 2.1 time: 0.278468 Sep 22 12:33:16.257211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 260/511] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:33:15 2022] DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments/830e5da3-6a66-4fc3-9b46-f4fbabf155c1 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:16.394889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:16.404022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b09b76c-5699-4d23-80bc-1d4038662792 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.207659 Sep 22 12:33:16.404725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 252/512] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:16 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:16.439553 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:16.441781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:16.449922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.450703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.451149 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.451915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.452650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.453914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.470957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:16.471579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:16.478376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.479444 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.479929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.480685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.481145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.481565 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.492224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b3936e2d-6d35-44c5-8b29-e2788337f243 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056865 Sep 22 12:33:16.493800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 261/513] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:16 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:16.634328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:16.642692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6eec3b86-08fc-4e0a-b1fd-3f864c338983 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.175706 Sep 22 12:33:16.643271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 253/514] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:16 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:16.681451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:16.682117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:16.692626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.693055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.693491 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.694197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:16.694680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:16.695137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:16.836745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:16.845782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:16.847228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:16.848401 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-65a06a4a-9cf9-40e6-ab14-542103653afe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.172915 Sep 22 12:33:16.848977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 262/515] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:16 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:17.427893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:17.428543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:17.435854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.436372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.436809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.437523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.437971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.438397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.504804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:17.506953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:17.513817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.514301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.514735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.515463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.515912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.516363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.557627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5f8fdfff-5517-416c-9e23-fbb7f1d2ad68 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056712 Sep 22 12:33:17.562569 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 263/516] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:17 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:17.590070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:17.598736 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-53f896ea-b9d8-4495-85e7-4f600c6e3e57 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.175487 Sep 22 12:33:17.599431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 254/517] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:17 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:17.667790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:17.668777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:17.675275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.675761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.676194 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.676998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.677743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.678167 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.827138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:17.835321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f6786535-ede6-4e12-bc8e-3fb9d1b59e91 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.171858 Sep 22 12:33:17.835887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 264/518] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:17 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:17.875082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:17.875694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:17.881697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.882175 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.882612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:17.883329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:17.884825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:17.885416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.036077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:18.045964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:18.047408 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:18.048599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-78d9700d-5fd6-4626-9a21-205e0186f564 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.177363 Sep 22 12:33:18.049160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 255/519] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:17 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:33:18.570436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:18.572724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:18.579565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.580048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.580507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.581230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.581677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.582103 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.614266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c553dc20-83e1-44a9-9da3-0d3e5bd5e22d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047716 Sep 22 12:33:18.614807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 265/520] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:18 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:18.622440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:18.623127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:18.630382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.630852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.631283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.631961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.632442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.632860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.762769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:18.771354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ea342fb-f932-4746-aa1b-0666bd26f7f9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.152690 Sep 22 12:33:18.772123 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 256/521] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:18 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:18.859009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:18.859618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:18.865589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.866077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.866513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:18.867231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:18.867685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:18.868111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.005064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:19.013731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-11a8242d-88cc-49c3-bd30-ea5e50da711d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.158632 Sep 22 12:33:19.014285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 266/522] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:18 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:19.074865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:19.075477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:19.081556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.082046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.082484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.083181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.083635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.084060 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.222248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:19.231926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:19.234877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:19.241419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4eb6b2ce-86e4-42e9-a5db-4ca728e449d3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.167415 Sep 22 12:33:19.241419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 257/523] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:19 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:19.627968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:19.630432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:19.636898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.637495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.638011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.638767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.639277 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.639772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.673818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e3d766a6-7345-4fd6-869a-a5862c5f218a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050386 Sep 22 12:33:19.674374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 267/524] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:19 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:19.795516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:19.796220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:19.803168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.803720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.804155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.804873 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:19.805316 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:19.806380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:19.942358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:19.950579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37cbdb6d-6a7e-4c28-ab56-d3d227b3561d tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.158978 Sep 22 12:33:19.951141 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 258/525] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:19 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:20.042224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:20.042832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:20.048770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.049258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.049690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.050372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.050819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.051239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.184901 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:20.193152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-28f1ef6a-8c7f-4991-af68-1e75a5a219dc tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1560 microversion: 2.1 time: 0.155444 Sep 22 12:33:20.193716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 268/526] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:20 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:20.265670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:20.266270 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:20.272312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.272796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.273225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.273929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.274888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.275309 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.400915 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:20.409407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:20.410826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:20.411963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df841415-f811-46d8-bd84-4a499c542db4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.150174 Sep 22 12:33:20.412561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 259/527] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:20 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:20.686269 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:20.688543 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:20.695899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.696938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.697374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.698067 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.698516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.698954 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.729032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-722a0089-3946-4846-8a67-1f798dc98ce9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Sep 22 12:33:20.729583 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 269/528] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:20 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:20.973558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:20.974165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:20.980889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.981367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.981801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:20.982487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:20.982942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:20.983361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.111737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:21.120512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c5068321-6e16-4223-a567-d2f92fcfefce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.150698 Sep 22 12:33:21.121077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 260/529] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:20 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:21.215909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:21.216456 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:21.222541 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.223016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.223446 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.224127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.224606 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.225024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.350122 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:21.358614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e5783306-5bca-47f3-b9e8-534f539880da tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1514 microversion: 2.1 time: 0.147094 Sep 22 12:33:21.359174 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 270/530] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:21 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:21.437526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:21.438134 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:21.444024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.444545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.444982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.445685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.446122 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.446542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.571990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:21.580863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:21.582312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:21.583500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea33f1e4-ea7b-4ecc-8b70-74e82207f6db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.149812 Sep 22 12:33:21.584170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 261/531] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:21 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:21.741333 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:21.743956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:21.750430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.750914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.751349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.752034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:21.752511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:21.752935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:21.782212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-df5dbc48-dde2-4973-9929-5e8b1bd5bf2b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Sep 22 12:33:21.782687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 271/532] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:21 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:22.143634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:22.144247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:22.150974 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.151452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.151887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.152599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.153051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.153474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.281172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:22.289258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d52d9bc5-a9b9-4177-a385-9143b445e007 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.149604 Sep 22 12:33:22.289814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 262/533] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:22 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:22.382234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:22.382770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:22.390147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.390791 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.391222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.391933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.392401 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.393071 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.539009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:22.548231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0bcae0f6-7f61-40fb-ae82-13c7091424a7 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1514 microversion: 2.1 time: 0.169945 Sep 22 12:33:22.548826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 272/534] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:22 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:22.609480 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:22.610090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:22.616033 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.616557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.616997 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.617690 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.618790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.619227 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.749639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:22.758087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:22.760096 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:22.761266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37876c6e-5fff-4cee-be04-aaafde277bd8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.155646 Sep 22 12:33:22.761825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 263/535] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:22 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:22.793946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:22.796113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:22.802549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.803026 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.803458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.804143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:22.804618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:22.805042 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:22.834150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-beaea96a-92eb-452f-85d5-8934b24e49e2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Sep 22 12:33:22.834676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 273/536] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:22 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:23.312536 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:23.313144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:23.319490 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.319971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.320433 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.321117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.321564 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.321984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.458235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:23.460417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:23.468109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ab476a9d-51de-43a6-b9c6-139650c1f784 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.159442 Sep 22 12:33:23.468705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 264/537] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:23 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:23.571390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:23.572001 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:23.577986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.578461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.578889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.579564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.580015 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.580470 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.706150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:23.714658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-035e461c-4ad2-47a4-bbad-776d125a7383 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1514 microversion: 2.1 time: 0.147082 Sep 22 12:33:23.715213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 274/538] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:23 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:23.787165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:23.787772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:23.793701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.794178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.794611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.795288 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.795734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.796151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.847340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:23.849416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:23.856327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.856826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.857492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.858129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:23.858585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:23.859008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:23.891319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4c243408-f477-4ad8-a119-c508d8f3b4bd tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048071 Sep 22 12:33:23.891907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 275/539] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:23 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:24.142639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:24.151147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:24.152598 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:24.153743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1654ead7-8f8c-4ef3-b2b6-3622f624572a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.370500 Sep 22 12:33:24.154295 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 265/540] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:23 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:33:24.491006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:24.491522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:24.498054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.498532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.498964 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.499646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.500091 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.500537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.634442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:24.646518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5de1b57-0078-4d23-b335-4f7600cd6c5a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.157936 Sep 22 12:33:24.646518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 276/541] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:24 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:24.738323 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:24.739674 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:24.756851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.757365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.759248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.760712 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.761191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.761621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.903751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:24.906227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:24.916984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.917800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.918474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.919403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:24.920501 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:24.921165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:24.925807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:24.975816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-722f1036-6de7-4227-bdaf-043f1ab56d89 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076350 Sep 22 12:33:24.982598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 277/542] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:24 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:25.083276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:25.091715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-792c68ae-ec2d-48e5-b399-5b015b35e922 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1514 microversion: 2.1 time: 0.357710 Sep 22 12:33:25.092559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 266/543] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:24 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:25.179146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:25.179775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:25.181602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:25.186863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.187342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:25.187772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:25.188521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.188973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:25.189390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:25.420838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:25.429502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:25.430930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:25.432082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-23106c7e-a733-48c9-9633-3711d5e1b969 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.257208 Sep 22 12:33:25.432202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d04cb8b-ca1a-46fa-995c-e2d41d452e06", "name": "network-vif-deleted", "tag": "542f47ac-43dd-4d65-b99a-3389e7f5abdc"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:25.432655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 278/544] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:25 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:25.441651 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.442120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:25.442548 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:25.453805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] Creating event network-vif-deleted:542f47ac-43dd-4d65-b99a-3389e7f5abdc for instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 on hv-cinder-85646 Sep 22 12:33:25.458767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-a2f59323-0f89-45bb-8c63-3c68d28d34c1 req-461c2352-1b04-4d2d-9926-76042dc82fc1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 Sep 22 12:33:25.459384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 267/545] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:25.670339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:25.671277 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:25.684686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.685170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:25.685600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:25.686298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.686750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:25.687171 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:25.814339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:25.823390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-00708ab6-cc6d-47cc-9a80-eaea1535c1eb tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.157877 Sep 22 12:33:25.823946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 279/546] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:25 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:25.990343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:25.992648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:25.999273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:25.999746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.000177 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.000888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.001338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.001759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.030554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e83107e2-02e9-4de2-9814-ca3f35c3c351 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044929 Sep 22 12:33:26.031472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 268/547] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:33:25 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:33:26.100963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:26.101527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:26.109850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.111118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.111766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.112906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.114033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.114638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.115793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:26.116505 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:26.123029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.123512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.123951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.124679 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.125131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.125552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.150371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:33:26.162730 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.163418 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.164119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.164801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'fault' on Instance uuid 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:26.224941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.236666 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b033aa5-34fb-4527-a15d-07f2bb499897 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1308 microversion: 2.1 time: 0.124591 Sep 22 12:33:26.237827 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 269/548] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:26 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:26.257801 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-132ea2a4-4bf1-4af1-919f-232b34aaadd1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 204 len: 0 microversion: 2.1 time: 0.160173 Sep 22 12:33:26.258659 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 280/549] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:33:26 2022] DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:33:26.266631 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:26.267360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:26.273937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.274930 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.275534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.276419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.277100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.277682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.412186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.420475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f5490721-4ac5-4390-92a6-a598888a07d9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1683 microversion: 2.1 time: 0.157583 Sep 22 12:33:26.421042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 270/550] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:26 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:26.457559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:26.458252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:26.464628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.465113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.465548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.466238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.466686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.467109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.593065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.601535 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.603854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.605055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c2c1413b-50b5-423e-a03b-d996b2b74f46 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.151704 Sep 22 12:33:26.605601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 281/551] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:26 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:26.846216 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:26.846863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:26.853304 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.853786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.854222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.854909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.855362 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.855789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.943158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:26.949391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:26.949953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:26.950459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:26.972043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Going to try to stop instance {{(pid=120604) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 22 12:33:26.985055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:26.993819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-edce1134-3fad-4ada-a1ac-31171720ef60 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1737 microversion: 2.1 time: 0.151437 Sep 22 12:33:26.994394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 271/552] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:26 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:27.015078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b08df757-c192-445b-a659-ca21d722349c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action" status: 202 len: 0 microversion: 2.1 time: 0.075505 Sep 22 12:33:27.015666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 282/553] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:33:26 2022] POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 12:33:27.023646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:27.024880 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:27.026855 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:27.031857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.032369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.032819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.033487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.033936 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.034357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.165062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.173273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0316e599-bb01-4cc7-bbad-b050f2c8f605 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1725 microversion: 2.1 time: 0.153473 Sep 22 12:33:27.173833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 272/554] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:27 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:27.266723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:27.267423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:27.273588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.274065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.274497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.275181 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.275634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.276056 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.308211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.308720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.309160 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.309606 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'fault' on Instance uuid 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:27.349445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.357507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dfef0fe5-861e-4843-9549-5f15273ae9a3 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1308 microversion: 2.1 time: 0.095339 Sep 22 12:33:27.358069 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 283/555] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:27 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:27.444198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:27.444975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:27.451865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.452506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.453046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.453829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.454384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.454904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.592520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.600648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-87315000-87ad-44df-8ca8-7f0965667f8d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1683 microversion: 2.1 time: 0.160528 Sep 22 12:33:27.601436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 273/556] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:27 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:27.630980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:27.631890 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:27.638025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.638520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.638959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.639649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:27.640102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:27.640559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:27.775043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.783584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.785050 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:27.786193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c9616925-05a5-4e04-9081-6a8f8fae3124 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.159861 Sep 22 12:33:27.786753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 284/557] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:27 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:28.019235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.019760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.026919 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.027395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.027823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.028538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.028988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.029406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.156906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.165794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5ff71548-53d6-409f-8b69-c5e0515d4671 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1717 microversion: 2.1 time: 0.149759 Sep 22 12:33:28.166354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 274/558] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:28.196810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.197539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.203428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.203983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.204527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.205308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.205864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.206349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.278427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.279106 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.285403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.286005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.286547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.287429 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.287986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.288557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.339555 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.347496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b2a39bb1-1d3f-4ff1-bae5-bf4e8ead2ad7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.154473 Sep 22 12:33:28.348065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 285/559] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:28.379230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] HTTP exception thrown: Cannot 'detach_volume' instance 4881b40d-864a-42ec-8c64-a1366dac5f05 while it is in vm_state rescued Sep 22 12:33:28.380517 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Request method failure captured: Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments/01c995da-16ff-4ad9-afbc-13870713ca2e HTTP/1.1 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUcj0K8tQrrX6-a54Yi10L4gYKD9mDkoaz30c9nagl9Z3VctGf0yaEEIAZIGHsEfToadDMBXHS0GmzzOm0aPxHFOxjdvgVHNLxM0WAO7Yb-ylj_f0MZhSnDRojLpuizq7LVpG7hXZAxfVHN02J9sVXnuwRZ4826fjZLv1h0rqZDX4I Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:33:28.380883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb62ca26c4fe47deb0a21511a96e6403"}]}] Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 0847f00afbde44068fcf1cedbce24be5 Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:33:28.382425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Cannot 'detach_volume' instance 4881b40d-864a-42ec-8c64-a1366dac5f05 while it is in vm_state rescued Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '4881b40d-864a-42ec-8c64-a1366dac5f05', 'id': '01c995da-16ff-4ad9-afbc-13870713ca2e'} Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:33:28.383243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4881b40d-864a-42ec-8c64-a1366dac5f05 while it is in vm_state rescued Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4881b40d-864a-42ec-8c64-a1366dac5f05 while it is in vm_state rescued Sep 22 12:33:28.385432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:33:28.386475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.386573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Returning 409 to user: Cannot 'detach_volume' instance 4881b40d-864a-42ec-8c64-a1366dac5f05 while it is in vm_state rescued {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:33:28.386573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0e8d34a-3be8-4365-8d9a-532eced9a845 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments/01c995da-16ff-4ad9-afbc-13870713ca2e" status: 409 len: 152 microversion: 2.1 time: 0.108568 Sep 22 12:33:28.386573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 275/560] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:33:28 2022] DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments/01c995da-16ff-4ad9-afbc-13870713ca2e => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 22 12:33:28.388386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.388871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.389303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.390000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.390480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.390908 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.391972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:28.392553 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.399190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.400210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.400659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.401345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.401793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.402209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.421828 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.422301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.422738 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.423178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'fault' on Instance uuid 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:28.468068 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.470241 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-573fa5ef-f3c3-4921-9ce4-05cd7002ab87 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/action" status: 202 len: 0 microversion: 2.1 time: 0.081742 Sep 22 12:33:28.474208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 276/561] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:33:28 2022] POST /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 12:33:28.476158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8d750e57-b594-46ca-a1c9-cb2a5f287109 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1308 microversion: 2.1 time: 0.099440 Sep 22 12:33:28.476902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 286/562] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:28.479475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.480176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.486293 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.486779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.487218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.487909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.488393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.488822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.614217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.623204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-34328e48-303c-49e0-8365-75bb597d9f09 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.147878 Sep 22 12:33:28.623849 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 277/563] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:28.624440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.625060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.630934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.631413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.631850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.632567 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.633022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.633445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.762816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.770871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fec379bb-7501-4e4d-b296-30706e151e9d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1683 microversion: 2.1 time: 0.150286 Sep 22 12:33:28.777903 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 287/564] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:28.812319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:28.812927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:28.818894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.819300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.819725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.820435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:28.820878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:28.822002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:28.948689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.957230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.958669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:28.959818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a041e462-03dd-4bd2-8522-cc526de9bd00 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.151387 Sep 22 12:33:28.960392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 278/565] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:28 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:29.374923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:29.375533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:29.382321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.382804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.383241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.383966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.384456 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.384885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.498936 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:29.499551 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:29.506077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.506569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.507005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.507708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.508161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.508688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.514792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:29.522419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b2f2069e-c33f-4c39-84a5-b91745a172d6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.151368 Sep 22 12:33:29.523072 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 288/566] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:29 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:29.543146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.543630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.544067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.544541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'fault' on Instance uuid 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:29.585458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:29.593697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8441788-0927-4fa9-a286-620ceb5542ef tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 200 len: 1308 microversion: 2.1 time: 0.098601 Sep 22 12:33:29.594241 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 279/567] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:29 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:29.647622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:29.648145 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:29.654633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.655112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.655543 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.656234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.656710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.657135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.795519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:29.796044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:29.803693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.804043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.804515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.805214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.805663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.806117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.833671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:29.948430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:29.963800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c87c47b9-781a-43de-bcc1-7e17b19745a0 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.319865 Sep 22 12:33:29.977737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 289/568] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:29 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:29.985361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:29.985972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:29.993070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.993564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.994037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:29.994741 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:29.995198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:29.995612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.019185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:30.116907 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:30.126772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-839269ed-262f-479f-bb17-6ebba443b741 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1683 microversion: 2.1 time: 0.336096 Sep 22 12:33:30.140778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 280/569] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:29 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1683 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:30.279946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:30.300093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:30.301625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:30.306955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-93aaeda0-33b6-462b-8008-d8c6f494376d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.321398 Sep 22 12:33:30.326541 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 290/570] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:29 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:30.551344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:30.553707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:30.555197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac05188-579c-4644-89f8-233e046b4618", "name": "network-vif-deleted", "tag": "3ccdb191-e1dc-4383-95e0-0dda555c85b6"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:30.564628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.565452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.566098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.566398 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.566877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.566987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.567307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.567566 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.568051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.581148 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] Creating event network-vif-deleted:3ccdb191-e1dc-4383-95e0-0dda555c85b6 for instance 9ac05188-579c-4644-89f8-233e046b4618 on hv-cinder-85646 Sep 22 12:33:30.586169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-7254b1a6-2b9b-4127-b6e0-2d2985b3e0ca req-7a6eedff-eb7e-4217-bfb7-30a727e8409f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037813 Sep 22 12:33:30.586751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 291/571] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:33:30.617493 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:30.618381 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: 6d04cb8b-ca1a-46fa-995c-e2d41d452e06] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:30.625697 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.626418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.627021 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.627825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.628520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.629054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.652979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] HTTP exception thrown: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Request method failure captured: Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 HTTP/1.1 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFW3-2sUocA18rpTvV3qlMkUYe90Xp2BybVZUlBRwP3YTApuKJu3wVVWZR4Muhrt1lMoQK7a9WdUaYO618uI9rzeT9y-b5y5NTq5cGQoOAOrLo6YrwEUOwgO5bMl5mvaJoQolY0WiMDh1TxyX_75kKzpEuS6V6H1lN9Cmo-_BaY67F4 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 24db83f7bc4d4888b73d4d4ab7c4bdce Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:33:30.654720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24db83f7bc4d4888b73d4d4ab7c4bdce"}]}] Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 24db83f7bc4d4888b73d4d4ab7c4bdce Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesSnapshotTestJSON-712578454-project Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 44c2913f48ad4200b6baf14c0830770c Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesSnapshotTestJSON-712578454-project Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. Sep 22 12:33:30.656252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '6d04cb8b-ca1a-46fa-995c-e2d41d452e06'} Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:33:30.657234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. Sep 22 12:33:30.658639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:30.659968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Returning 404 to user: Instance 6d04cb8b-ca1a-46fa-995c-e2d41d452e06 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:33:30.659968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-36b5969e-0702-4035-a882-c818a3356204 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06" status: 404 len: 111 microversion: 2.1 time: 0.044844 Sep 22 12:33:30.660397 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 292/572] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:30 2022] GET /compute/v2.1/servers/6d04cb8b-ca1a-46fa-995c-e2d41d452e06 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:33:30.766984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:30.781449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f21b2c5-5457-4275-8b0e-8e58e80186bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.237425 Sep 22 12:33:30.782989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 281/573] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:30 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:30.989472 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:30.990000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:30.996383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.997143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.997708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:30.998421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:30.998900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:30.999328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.128645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.137522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2e43ab14-9de0-4755-bcd7-0699725a4486 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.151860 Sep 22 12:33:31.138041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 293/574] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:30 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:31.155399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:31.156009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:31.161892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.162364 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.162789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.163468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.163914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.164354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.194350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.194822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.195247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.195681 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:31.235967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.243825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-96189dd2-74ef-4e0c-9f7b-1a4554f2bb9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1332 microversion: 2.1 time: 0.092051 Sep 22 12:33:31.244343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 282/575] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:31 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:31.333200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:31.333805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:31.340383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.340870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.341304 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.341993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.342441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.342860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.472643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.481557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.482989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.484135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e076fea4-a0da-4e4e-ac28-1becb3046800 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.154833 Sep 22 12:33:31.484719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 294/576] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:31 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:31.807317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:31.807889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:31.814495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.814978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.815411 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.816104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:31.816579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:31.817005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:31.951281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:31.958992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-897a7473-7646-4e2f-8dfc-0442d26d2f5a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.156102 Sep 22 12:33:31.959554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 283/577] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:31 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:32.161513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:32.162113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:32.168723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.169197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.169624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.170305 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.170749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.171165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.266511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:32.267210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:32.273109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.273627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.274056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.274741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.275187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.275607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.300681 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:32.307058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.307544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.308002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.308481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:32.309474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-15989e71-0602-4e4a-8ec1-029ef1965cac tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.151885 Sep 22 12:33:32.310037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 295/578] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:32 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:32.346907 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:32.355339 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-98fb43b2-27ea-4cde-b8d0-e3a8789e9e99 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1332 microversion: 2.1 time: 0.092689 Sep 22 12:33:32.355880 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 284/579] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:32 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:32.509741 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:32.510265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:32.516272 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.516781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.517212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.517898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.518347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.518771 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.643856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:32.653085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:32.654518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:32.655655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2c8a158c-a94e-40d3-a61a-e0a17173102a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.150008 Sep 22 12:33:32.656207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 296/580] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:32 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:32.981975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:32.982598 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:32.989038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.989524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.989952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:32.990635 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:32.991087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:32.991510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.120507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.128204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9c2282c9-6a2b-4d3b-b896-88b6c7f470b6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.150031 Sep 22 12:33:33.128729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 285/581] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:32 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:33.332546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:33.333154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:33.339538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.340020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.340488 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.341178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.341629 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.342052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.378724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:33.379285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:33.385956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.386445 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.386878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.387582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.388036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.388496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.418822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.419310 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.419798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.420249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:33.467037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.474882 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa148f24-be98-4196-a6f6-70475c8133b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1332 microversion: 2.1 time: 0.100027 Sep 22 12:33:33.475447 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 286/582] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:33 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:33.493507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.502344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-74d0c6b1-23c1-45bc-84f6-1d15445e2812 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.173689 Sep 22 12:33:33.502967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 297/583] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:33 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:33.681273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:33.681792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:33.687607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.688089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.688545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.689224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:33.689668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:33.690090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:33.818186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.826766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.828238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:33.829460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59c54f3c-b098-4031-9261-00069f0c5912 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.152203 Sep 22 12:33:33.830015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 287/584] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:33 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:34.152461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:34.153069 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:34.158999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.159481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.159915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.160626 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.161077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.161498 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.289232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:34.296935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a82183df-8676-4e01-9036-6b6cefb12cd4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.148886 Sep 22 12:33:34.297494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 298/585] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:34 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:34.498058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:34.498629 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:34.505275 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.505757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.506192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.506884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.507329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.507743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.530549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:34.531447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:34.539702 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.540639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.541289 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.542261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.542943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.543073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.543515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.543855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.544111 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.544597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:34.597764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:34.606161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7d5aa6d9-5350-41ef-b7f8-bfb4e4e86e45 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1332 microversion: 2.1 time: 0.111943 Sep 22 12:33:34.606878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 288/586] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:34 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:34.624133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "name": "network-vif-plugged", "status": "completed", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:34.634794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.635273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.635699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.646959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] Creating event network-vif-plugged:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:33:34.652672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-687ef8bd-b6bb-4f68-aaa7-de501fa51704 req-675fbffc-2068-48e6-9bc5-d1120d897f14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034200 Sep 22 12:33:34.653483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 289/587] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:34.697867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:34.709829 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-11a59454-69cd-4b20-a5f9-db9edd3ceb27 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1725 microversion: 2.1 time: 0.183603 Sep 22 12:33:34.710393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 299/588] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:34 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:34.854984 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:34.855832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:34.862100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.862593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.863032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.863728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:34.864190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:34.864642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:34.994611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.003149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.004783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.005797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1c8eba41-e4a1-42f0-b3b8-e51c915cb9b6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.156071 Sep 22 12:33:35.006342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 290/589] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:34 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:35.319907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:35.320544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:35.326830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.327347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.327778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.328563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.329044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.329466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.469532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.478915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a02ddbee-5d91-4489-a267-d94104f8e4f0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.162127 Sep 22 12:33:35.479650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 300/590] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:35 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:35.628573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:35.629208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:35.635643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.636133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.636607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.637300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.637758 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.638187 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.669061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.669472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.669910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.670354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 9ac05188-579c-4644-89f8-233e046b4618 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:33:35.709032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.717144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8db1bf20-09b3-43ca-9b0a-6be0048402d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 200 len: 1332 microversion: 2.1 time: 0.092483 Sep 22 12:33:35.717701 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 291/591] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:35 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:35.735400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:35.736185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:35.742577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.743078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.743546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.744303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.744774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.745203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.891146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:35.899404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ad94be1e-7536-4f82-b92b-2dbff5f607dc tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1731 microversion: 2.1 time: 0.168417 Sep 22 12:33:35.900614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 301/592] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:35 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:35.922795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:35.923254 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:35.929118 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.929599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.930032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:35.930717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:35.931219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:35.931640 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.008427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7f405107-46c6-47dc-b0d1-6ddbb9ed53e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089472 Sep 22 12:33:36.009550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 292/593] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:33:35 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:36.031436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:36.032039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:36.038001 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.038480 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.038937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.039765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.040215 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.040721 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.262953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:36.273085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:36.274738 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:36.275891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f0612350-ef1a-4fd7-bd30-4c435c2ebd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.248364 Sep 22 12:33:36.276639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 302/594] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:36 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:36.502659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:36.503293 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:36.509331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.509812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.510241 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.510996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.511494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.511991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.739897 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:36.740563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:36.747117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.747604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.748036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.748942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:36.749390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:36.749814 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:36.763707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 HTTP/1.1 Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:33:36.765219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:33:36.766691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '9ac05188-579c-4644-89f8-233e046b4618'} Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:33:36.767698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:33:36.768959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:33:36.769989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:33:36.769989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a2eef0d7-de6d-43cb-bec6-2550127f136b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 404 len: 111 microversion: 2.1 time: 0.030550 Sep 22 12:33:36.769989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 303/595] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:36 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:33:36.775629 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d1661c49-4b37-4e79-9f69-e0882900d9f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '.version_select at 0x7f1079a74ca0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:36.795179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d1661c49-4b37-4e79-9f69-e0882900d9f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419290831" status: 202 len: 0 microversion: 2.1 time: 0.023579 Sep 22 12:33:36.796074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 304/596] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 22 12:33:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1419290831 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:36.907629 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:36.916482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0250d33d-b781-4e73-9574-0a214b72c16c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.417730 Sep 22 12:33:36.917381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 293/597] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:36 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:37.272782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:37.290043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:37.290798 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:37.291248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:37.303308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:37.304181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:37.311717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:37.312407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:37.313076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:37.314020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:37.314695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:37.315344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:37.316472 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] Creating event network-changed:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:33:37.324777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-a168684d-60d9-4d5e-b817-98bec014bb96 req-5f3f792d-29c9-4012-9910-1467efd0e264 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055502 Sep 22 12:33:37.328794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 305/598] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:37.475157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:37.484953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:37.486518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:37.487757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e076dcc7-cd73-4371-b463-fe639843eed5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.189035 Sep 22 12:33:37.488869 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 294/599] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:37 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:33:37.689946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e711f634-4d83-4579-81bd-9164b36faa7e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: .version_select at 0x7f1079bbb5e0>, body: {"keypair": {"name": "tempest-keypair-377352460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcGLoDkun+d83mK2LTpZQNmVDYhuyWbu+8PrHhJLK8JWANRCGt4kE/f9Ryrxfi+DIJrnhIrxcEUe8Gl66ylY+la3MI0wBLTyz3hxBuKecBy3FexqVl/Erp+lHxC9bomww=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:37.705513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e711f634-4d83-4579-81bd-9164b36faa7e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:33:37.709527 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e711f634-4d83-4579-81bd-9164b36faa7e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:33:37.732807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e711f634-4d83-4579-81bd-9164b36faa7e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047059 Sep 22 12:33:37.733408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 306/600] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:33:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:37.939797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:37.940421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:37.946790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:37.947286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:37.947719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:37.948616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:37.949417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:37.950529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:38.097510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:38.106149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59404a75-e4bc-429b-afde-64c987c4fe6c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.170083 Sep 22 12:33:38.116255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 295/601] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:37 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:38.514644 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:38.515959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:38.522393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:38.523146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:38.523963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:38.525003 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:38.525582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:38.526082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:38.674043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:38.683489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:38.684990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:38.686212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f3c1ef8f-0616-4d63-b24b-68cfdf5af05a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.176210 Sep 22 12:33:38.686770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 307/602] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:38 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:39.041974 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1087573913", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd"}], "security_groups": [{"name": "tempest-securitygroup--901975899"}], "key_name": "tempest-keypair-377352460", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:39.129860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:39.130386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:39.137047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.137537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.137977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.138677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.139134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.139561 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.143981 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] validate_networks() for [('a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:33:39.349530 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:39.357689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-518d7706-6405-44cc-8ed9-96b00891cc68 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.231802 Sep 22 12:33:39.358278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 308/603] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:39 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:39.362840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:39.373649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.374126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.374560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.387840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] Creating event network-changed:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:33:39.392668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-b00519f5-45cf-4205-8365-49cf726cb388 req-8fd3aba6-ef11-42b4-9ba4-e5cdb7a99128 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Sep 22 12:33:39.393257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 309/604] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:39.629703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:33:39.630468 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:33:39.630790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:33:39.631201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:33:39.631873 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:33:39.641746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.642227 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.642665 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.643393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.643842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.644260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.666078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:33:39.670568 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:33:39.683090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:33:39.685450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:33:39.689840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1550627813", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "networks": [{"uuid": "132b9a18-7a8b-4760-bd77-25e68aa07772"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:39.739420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8c946c3a-1f52-4351-8a8b-960ee32ec4f1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.701658 Sep 22 12:33:39.740236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 296/605] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:33:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 12:33:39.751431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] validate_networks() for [('132b9a18-7a8b-4760-bd77-25e68aa07772', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:33:39.753711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:39.754787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:39.761962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.762449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.762885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.763583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:39.764033 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:39.764491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:39.767395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:40.003848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.016486 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.023021 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.039853 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7811d4b-c588-4311-a491-6bc68f6ab52b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1809 microversion: 2.20 time: 0.288815 Sep 22 12:33:40.041060 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 297/606] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:39 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:40.063266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-961ae981-06b5-49cd-8b5c-88490dd496d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:40.064778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-961ae981-06b5-49cd-8b5c-88490dd496d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:40.169382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-961ae981-06b5-49cd-8b5c-88490dd496d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.176864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-961ae981-06b5-49cd-8b5c-88490dd496d1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1241 microversion: 2.1 time: 0.133614 Sep 22 12:33:40.177552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 298/607] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:40 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:40.271200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:33:40.272344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:33:40.272880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:33:40.273650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:33:40.274212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:33:40.284444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:40.284933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:40.285482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:40.286207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:40.286670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:40.287094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:40.305239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Getting quotas for project 24db83f7bc4d4888b73d4d4ab7c4bdce. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:33:40.310986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Getting quotas for user 44c2913f48ad4200b6baf14c0830770c and project 24db83f7bc4d4888b73d4d4ab7c4bdce. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:33:40.323689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:33:40.326255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:33:40.348944 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:40.382999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-39c786b4-71a2-4238-a2cb-dc47428051d9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698732 Sep 22 12:33:40.384838 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:40.385900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:40.388447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 310/608] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 22 12:33:40.400394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:40.400814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:40.401644 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3903ff9c-029c-48f8-8274-23b98ec2b679 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:40.403116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3903ff9c-029c-48f8-8274-23b98ec2b679 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:40.436633 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:40.437501 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:40.444945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:40.445866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:40.461889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3903ff9c-029c-48f8-8274-23b98ec2b679 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.469150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3903ff9c-029c-48f8-8274-23b98ec2b679 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1219 microversion: 2.1 time: 0.073244 Sep 22 12:33:40.470238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 311/609] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:40 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:40.619854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:40.632078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8ad859df-4d29-47cc-b57d-cd1ae8039dc1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.254678 Sep 22 12:33:40.632685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 299/610] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:40 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:41.066249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:41.066848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:41.074188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.074663 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.075089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.075766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.076211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.076661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.201794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:41.203047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:41.210163 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.215758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.220336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.221094 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.221845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.222308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.222729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.240461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.251658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.253341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-842c2340-1409-4a67-bbc1-a4ec47f3e3dd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1796 microversion: 2.20 time: 0.191000 Sep 22 12:33:41.254520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 312/611] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:33:41 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1796 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:33:41.332127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.342202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2c36d3a5-c3bb-4572-8459-16b04a559ba4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1301 microversion: 2.1 time: 0.145837 Sep 22 12:33:41.356501 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 300/612] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:41 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1301 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:41.492500 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:41.493136 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:41.499643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.500131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.500625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.501312 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.501762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.502184 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.572537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.580229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-603b2380-e059-4538-9a16-fc98d4f69625 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1271 microversion: 2.1 time: 0.091483 Sep 22 12:33:41.580930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 313/613] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:41 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:41.656775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:41.657504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:41.663398 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.663996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.664696 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.666168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:41.667102 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:41.667771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:41.875386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:41.883163 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-70c7253a-453f-42af-9f1f-aeb83b6f4e23 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.230215 Sep 22 12:33:41.883814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 301/614] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:41 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:42.366303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:42.367075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:42.374592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.375400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.375937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:42.376929 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.377664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.378150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:42.381137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=100 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:42.602866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:42.603489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:42.609895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.610394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.610826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:42.611727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.612381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.612811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:42.638444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:42.646323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cface958-0326-4b57-92da-ed8f7f983fd3 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.283833 Sep 22 12:33:42.646981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 314/615] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:42 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:42.811668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:42.820558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a207af8e-3cee-4bce-82b7-27f6ef13a597 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.221625 Sep 22 12:33:42.822043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 302/616] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:42 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:42.907089 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:42.907798 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:42.915843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.916623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.917062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:42.918815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:42.919352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:42.919785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.128012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:43.137481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-799c7fe1-39a9-4112-8942-74cadb17f136 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.234437 Sep 22 12:33:43.148556 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 315/617] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:42 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:43.229186 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cc8e1d-1561-4c72-a891-28be6d887da5", "tag": "9c84ffaa-e05f-4013-bb0a-aa84ec774557"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:43.241043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.241822 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.242602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.255750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] Creating event network-changed:9c84ffaa-e05f-4013-bb0a-aa84ec774557 for instance 71cc8e1d-1561-4c72-a891-28be6d887da5 on hv-cinder-85646 Sep 22 12:33:43.261368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-45242b81-79fa-4c81-8806-fc5687af3ef3 req-0b7afe89-c398-40ed-b856-195b06b8bdda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036238 Sep 22 12:33:43.262207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 303/618] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:43.423435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbb80529-c090-42c7-b17b-d1fe8788077c", "tag": "6c1fe562-c0a8-41aa-8e46-071a8a762864"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:43.439220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.440041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.440691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.455148 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] Creating event network-changed:6c1fe562-c0a8-41aa-8e46-071a8a762864 for instance bbb80529-c090-42c7-b17b-d1fe8788077c on hv-cinder-85646 Sep 22 12:33:43.461140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-4d2804c4-cc10-4a14-9e19-d7dbf1bf8bbe req-bd04f7e6-274a-4363-a524-ce5ac730444d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041892 Sep 22 12:33:43.461854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 316/619] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:43.672920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:43.673637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:43.680069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.680593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.681636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.682373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.682856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.683274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.845381 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:43.846075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:43.853211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.853862 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.854236 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:43.855037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:43.855674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:43.856158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:44.047226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:44.051077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:44.055272 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21287687-5ab1-4a6b-b614-1d64fa9e88de tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.387521 Sep 22 12:33:44.055909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 304/620] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:43 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:44.058748 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-acafb322-eb9f-4fea-b22d-d558636f6c7d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.218096 Sep 22 12:33:44.059291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 317/621] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:43 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:44.161445 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:44.162055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:44.168608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:44.169087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:44.169520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:44.170204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:44.170655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:44.171080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:44.297106 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:44.304877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-63aaee92-1c9f-43fa-852a-f234c602b97a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1679 microversion: 2.1 time: 0.147207 Sep 22 12:33:44.305435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 305/622] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:44 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:45.077743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:45.078386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:45.080991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:45.083235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:45.085146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.085637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.086070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.086767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.087236 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.087648 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.088599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.089103 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.089541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.090439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.090898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.091326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.280438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:45.284552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:45.288833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-676fdefd-bddd-4ab2-a1fd-ec812141976c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.215013 Sep 22 12:33:45.289492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 318/623] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:45 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:45.292803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a465356-274a-4862-b03d-3c38be14ffdd tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.215777 Sep 22 12:33:45.293367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 306/624] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:45 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:45.326798 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:45.327441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:45.333326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.333813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.334244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.334935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.335428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.335854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.464058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:45.471760 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e5590164-4acd-4a64-9429-6481e1e195c0 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1656 microversion: 2.1 time: 0.148766 Sep 22 12:33:45.472341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 319/625] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:45 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1656 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:45.495190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:45.497263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:45.502732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.503226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.503660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.527240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Going to try to start instance {{(pid=120603) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 22 12:33:45.567580 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e0d8f4ad-4725-4629-859b-3e588a51c815 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action" status: 202 len: 0 microversion: 2.1 time: 0.076683 Sep 22 12:33:45.568188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 307/626] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:33:45 2022] POST /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:33:45.576138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:45.576773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:45.582682 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.583152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.583580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.584252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:45.584762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:45.585179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:45.721856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:45.730509 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-253cdabb-5f5c-4497-84fc-97534556fd4c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1665 microversion: 2.1 time: 0.158139 Sep 22 12:33:45.731070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 320/627] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:45 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:46.312705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:46.314114 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:46.314691 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:46.315304 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:46.322168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.322654 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.323047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.323175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:46.323765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.324101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.324223 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.324647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:46.325084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:46.326039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.326715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.327343 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:46.729856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:46.736060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:46.737934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2943fc0-11d7-48eb-a440-d3ae77790180 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.429988 Sep 22 12:33:46.752321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 308/628] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:46 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:46.752510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0c48b205-7f97-4fe7-864a-1f734674cfa9 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.432909 Sep 22 12:33:46.752510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 321/629] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:46 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:46.764874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:46.765491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:46.771350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.771846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.772286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:46.773004 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:46.773465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:46.773892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.014976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:47.022569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1550bcd4-96df-45fc-8fad-a374e992c968 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1665 microversion: 2.1 time: 0.261475 Sep 22 12:33:47.023142 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 309/630] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:46 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1665 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:47.725658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb80529-c090-42c7-b17b-d1fe8788077c", "name": "network-vif-plugged", "status": "completed", "tag": "6c1fe562-c0a8-41aa-8e46-071a8a762864"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:47.736779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:47.737266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:47.737677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.749414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] Creating event network-vif-plugged:6c1fe562-c0a8-41aa-8e46-071a8a762864 for instance bbb80529-c090-42c7-b17b-d1fe8788077c on hv-cinder-85646 Sep 22 12:33:47.754016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-c65a9f11-bc1b-4360-9311-e96180dc701c req-f8a1946a-fbbe-4b35-bc92-29dbd8d2d40c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032087 Sep 22 12:33:47.754602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 322/631] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:47.761393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:47.762086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:47.768188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:47.768947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:47.769285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:47.769772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:47.770263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.771211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:47.772157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:47.772621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.775753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:47.776238 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:47.776685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.778407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:47.778407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:47.778407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:47.973200 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:47.977062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:47.982594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a7e36002-840a-41bd-91c9-021cd8bfcd6b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.224981 Sep 22 12:33:47.983306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 310/632] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:47 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:47.991126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-95f733c6-c2a3-4bbb-a032-b0fbcdd70820 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.227445 Sep 22 12:33:48.004772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 323/633] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:47 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:48.046287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:48.046893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:48.053203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:48.053693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:48.054131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:48.054831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:48.055287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:48.055741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:48.259601 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:48.267487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e4d4ccfa-b375-445c-9c2f-ceff12bdc68c tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1669 microversion: 2.1 time: 0.225002 Sep 22 12:33:48.268048 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 311/634] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:48 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1669 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:49.008172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:49.008827 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:49.013648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:49.014255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:49.015309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:49.015804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:49.016248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:49.016949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:49.017395 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:49.017825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:49.020557 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:49.021030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:49.021455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:49.022133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:49.022575 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:49.022989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:49.204568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:49.211781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:49.212207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-342df428-92ec-4dd9-b0c2-936d6c2e33e0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.207900 Sep 22 12:33:49.213444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 324/635] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:49 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:49.221864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ff3eb8dd-3452-450d-841d-8d48bcff052c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1319 microversion: 2.1 time: 0.211900 Sep 22 12:33:49.222499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 312/636] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:49 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:49.773417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cc8e1d-1561-4c72-a891-28be6d887da5", "name": "network-vif-plugged", "status": "completed", "tag": "9c84ffaa-e05f-4013-bb0a-aa84ec774557"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:49.782848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:49.783319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:49.783774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:49.794973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] Creating event network-vif-plugged:9c84ffaa-e05f-4013-bb0a-aa84ec774557 for instance 71cc8e1d-1561-4c72-a891-28be6d887da5 on hv-cinder-85646 Sep 22 12:33:49.799610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-c0a946e8-b5df-4455-aae8-18dfe34b61c6 req-63ca5645-c31e-4f4d-a566-2921db029a0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Sep 22 12:33:49.800186 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 325/637] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:50.236234 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:50.237392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:50.240156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:50.241359 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:50.246357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:50.247098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.247227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:50.247597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.248039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.248775 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.249238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.249664 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.260243 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.260768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.261519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.261903 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.262362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.262786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.296146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:50.439779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:50.449994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6b257f22-69dc-4077-959c-d385d5746349 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.218090 Sep 22 12:33:50.450925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 313/638] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:50 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:50.452093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:50.460101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7b09281f-ca2e-4601-aedc-011d1cfd8c0d tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1508 microversion: 2.1 time: 0.219445 Sep 22 12:33:50.460786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 326/639] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:50 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:33:50.489927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ec0fa07-a035-4553-b70c-478bec48f154", "device": "/dev/sdb"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:50.492511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:50.499061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.499750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.500185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.500910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:50.501358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:50.501776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:50.515054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:51.180528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e2272d6f-aaa7-4bdc-bd83-e12ecafb78f4 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "POST /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698392 Sep 22 12:33:51.181136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 314/640] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:33:50 2022] POST /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:51.473027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:51.473620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:51.475414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=12 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:33:51.481326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:51.481920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:51.482356 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:51.483048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:51.483503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:51.483930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:51.611005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:51.618557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-83c704b0-4638-4165-ad2c-04953c334450 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1366 microversion: 2.1 time: 0.149466 Sep 22 12:33:51.619612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 327/641] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:51 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:52.643905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:52.644662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:52.650856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:52.651340 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:52.651779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:52.652504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:52.652961 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:52.653395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:52.779540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:33:52.787156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8694be14-a04a-402f-8c76-58ff3a1fd174 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1557 microversion: 2.1 time: 0.148013 Sep 22 12:33:52.787717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 315/642] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:33:52 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:33:52.808972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:33:52.809466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:33:52.815999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:52.816532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:52.816980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:52.817670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:52.818126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:52.818550 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:52.897852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d8dc6095-e9c5-4077-a1c4-e04dbaccb8fc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092693 Sep 22 12:33:52.898453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 328/643] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:33:52 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:33:54.023099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71cc8e1d-1561-4c72-a891-28be6d887da5", "tag": "9c84ffaa-e05f-4013-bb0a-aa84ec774557"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:33:54.033422 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:33:54.033985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:33:54.034474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:33:54.045571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] Creating event network-changed:9c84ffaa-e05f-4013-bb0a-aa84ec774557 for instance 71cc8e1d-1561-4c72-a891-28be6d887da5 on hv-cinder-85646 Sep 22 12:33:54.050391 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-3aa02026-8bd0-4d8e-8fab-b0c6e3e055eb req-5469b10b-e4c7-4d52-a7fb-da5616a5bf14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031136 Sep 22 12:33:54.050980 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 316/644] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:10.533895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=38 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:10.534889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=75 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:10.538919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:10.539436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:10.546884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:10.547366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:10.547801 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:10.548512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:10.548964 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:10.549387 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:10.781466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'services' on Instance uuid bbb80529-c090-42c7-b17b-d1fe8788077c {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:10.850384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b8a4cadb-8ee5-4ac1-839a-64a0da46ba43 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c/os-volume_attachments/3ec0fa07-a035-4553-b70c-478bec48f154" status: 202 len: 0 microversion: 2.1 time: 0.317812 Sep 22 12:34:10.850961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 329/645] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:34:10 2022] DELETE /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c/os-volume_attachments/3ec0fa07-a035-4553-b70c-478bec48f154 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:34:11.971981 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=19 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:11.972758 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:11.977039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:11.977891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:11.985029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:11.985521 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:11.985952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:11.986642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:11.987092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:11.987512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:12.013962 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:12.087319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e9c32cd-d612-4388-aed0-11b6fb3a6526 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 204 len: 0 microversion: 2.1 time: 0.116601 Sep 22 12:34:12.088379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 317/646] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:11 2022] DELETE /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:12.098898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:12.099592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:12.106935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:12.107449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:12.107887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:12.108642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:12.109094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:12.109522 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:12.246851 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:12.254510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-713d580d-1a1e-48f3-b14e-c32db5802b9b tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1514 microversion: 2.1 time: 0.160618 Sep 22 12:34:12.255111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 330/647] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:12 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:13.278320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:13.278936 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:13.285460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:13.285938 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:13.286366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:13.287049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:13.287495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:13.287921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:13.513804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:13.521561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c64c0363-e721-4558-bce6-cb0776e1bf2c tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1514 microversion: 2.1 time: 0.247674 Sep 22 12:34:13.522124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 318/648] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:13 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:14.431843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbb80529-c090-42c7-b17b-d1fe8788077c", "name": "network-vif-deleted", "tag": "6c1fe562-c0a8-41aa-8e46-071a8a762864"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:14.443900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:14.444403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:14.445165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:14.459408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] Creating event network-vif-deleted:6c1fe562-c0a8-41aa-8e46-071a8a762864 for instance bbb80529-c090-42c7-b17b-d1fe8788077c on hv-cinder-85646 Sep 22 12:34:14.465040 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-b8b6119c-b5d6-402c-8eda-2b580d0fc6b2 req-57bdd4d0-47b2-4260-a9ea-5f9cd2cbbbcb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036822 Sep 22 12:34:14.465654 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 331/649] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:14.544748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:14.545354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:14.551743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:14.552225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:14.552685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:14.553368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:14.553812 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:14.554228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:14.585494 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:14.585968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:14.586397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:14.586830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lazy-loading 'fault' on Instance uuid bbb80529-c090-42c7-b17b-d1fe8788077c {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:14.627708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c2913f48ad4200b6baf14c0830770c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24db83f7bc4d4888b73d4d4ab7c4bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:14.636007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-80fb08da-d5f7-4afb-ad66-e306f9d5604f tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 200 len: 1309 microversion: 2.1 time: 0.094747 Sep 22 12:34:14.636581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 319/650] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:14 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:15.659904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:15.660630 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] [instance: bbb80529-c090-42c7-b17b-d1fe8788077c] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:15.667280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:15.667758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:15.668182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:15.668875 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:15.669319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:15.669733 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:15.682603 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] HTTP exception thrown: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Request method failure captured: Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c HTTP/1.1 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFW3-2sUocA18rpTvV3qlMkUYe90Xp2BybVZUlBRwP3YTApuKJu3wVVWZR4Muhrt1lMoQK7a9WdUaYO618uI9rzeT9y-b5y5NTq5cGQoOAOrLo6YrwEUOwgO5bMl5mvaJoQolY0WiMDh1TxyX_75kKzpEuS6V6H1lN9Cmo-_BaY67F4 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 24db83f7bc4d4888b73d4d4ab7c4bdce Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:34:15.684214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/24db83f7bc4d4888b73d4d4ab7c4bdce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_24db83f7bc4d4888b73d4d4ab7c4bdce"}]}] Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 24db83f7bc4d4888b73d4d4ab7c4bdce Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-712578454 Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesSnapshotTestJSON-712578454-project Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 44c2913f48ad4200b6baf14c0830770c Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesSnapshotTestJSON-712578454-project Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. Sep 22 12:34:15.685837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'bbb80529-c090-42c7-b17b-d1fe8788077c'} Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:15.686797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. Sep 22 12:34:15.688313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:15.690008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] Returning 404 to user: Instance bbb80529-c090-42c7-b17b-d1fe8788077c could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:15.690008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-66240357-3b54-41e2-89a5-4aea9c9b1203 tempest-VolumesSnapshotTestJSON-712578454 tempest-VolumesSnapshotTestJSON-712578454-project] 10.222.0.33 "GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c" status: 404 len: 111 microversion: 2.1 time: 0.030344 Sep 22 12:34:15.690008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 332/651] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:15 2022] GET /compute/v2.1/servers/bbb80529-c090-42c7-b17b-d1fe8788077c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:34:25.056641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:25.057199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:25.059653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:25.060427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:25.066261 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:25.066733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:25.067165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:25.067851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:25.068358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:25.069004 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:25.150435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'services' on Instance uuid 4881b40d-864a-42ec-8c64-a1366dac5f05 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:25.222613 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-01d82c3d-fc24-4db3-8262-5b1d41f90381 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments/01c995da-16ff-4ad9-afbc-13870713ca2e" status: 202 len: 0 microversion: 2.1 time: 0.169644 Sep 22 12:34:25.223283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 320/652] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:34:25 2022] DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments/01c995da-16ff-4ad9-afbc-13870713ca2e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:34:25.233354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:25.235661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:25.242506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:25.243054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:25.243703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:25.246382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:25.246382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:25.246382 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:25.292857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0a451c2c-a174-46b2-8307-92ea4b2637c9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063218 Sep 22 12:34:25.293444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 333/653] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:25 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:26.302891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 12:34:26.303412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Thu Sep 22 12:34:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments (ip 10.222.0.33) !!! Sep 22 12:34:26.308513 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:26.310803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:26.318443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:26.318928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:26.319366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:26.320055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:26.320538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:26.320969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:26.351115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fb5a5c23-bdd7-4cd1-8e60-05abd1ab96a8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049468 Sep 22 12:34:26.351788 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 321/654] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:26 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:27.364371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:27.366598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:27.373130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:27.373616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:27.374084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:27.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:27.375235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:27.375659 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:27.407070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-953cdbd5-b089-4c41-b28b-7a5205c93471 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Sep 22 12:34:27.407627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 334/655] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:27 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:28.419474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:28.421646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:28.427963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:28.428477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:28.428912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:28.429597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:28.430046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:28.430466 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:28.461832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-313c37cc-9c76-4c78-88b4-53b0e807b716 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Sep 22 12:34:28.462419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 322/656] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:28 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:29.206893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.207483 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.214301 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.214774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.215203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.215883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.216355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.216806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.245448 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-032d768e-3aff-4124-92c4-48320c154602 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments/03b3a237-c5e9-4957-809b-009128186b05" status: 200 len: 194 microversion: 2.20 time: 0.042547 Sep 22 12:34:29.246008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 335/657] 10.222.0.33 () {60 vars in 1454 bytes} [Thu Sep 22 12:34:29 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments/03b3a237-c5e9-4957-809b-009128186b05 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:34:29.315090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.315582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.321639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.322126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.323124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.323811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.324314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.324751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.403727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lazy-loading 'services' on Instance uuid 15c97c51-b54b-48e0-9929-cc535246eb97 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:29.475803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.478153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0db753d3-11b2-4aba-a501-9e8531c12de1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments/03b3a237-c5e9-4957-809b-009128186b05" status: 202 len: 0 microversion: 2.20 time: 0.166369 Sep 22 12:34:29.478668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.482109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 323/658] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Sep 22 12:34:29 2022] DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments/03b3a237-c5e9-4957-809b-009128186b05 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:29.484855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.485344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.485789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.486641 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.487093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.487696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.488406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.491265 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.500258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.500988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.501588 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.503532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.505137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.505595 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.521628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-65264c2e-21c3-4103-8fe0-bdf8f056ab73 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050586 Sep 22 12:34:29.522315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 336/659] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:29 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 22 12:34:29.538616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8615286d-2fbe-4b0f-8ae9-456ca67e9f2b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054494 Sep 22 12:34:29.539481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 324/660] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:29 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:34:29.603604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.604378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.610454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.610945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.611412 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.612378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.612996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.613445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.640464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:29.715848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-03af224b-14cf-493d-b0f5-1adf9633d3b7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 204 len: 0 microversion: 2.1 time: 0.116153 Sep 22 12:34:29.716445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 337/661] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:29 2022] DELETE /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 12:34:29.724482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:29.725086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:29.732367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.732854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.733279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.734035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:29.734479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:29.734902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:29.884053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:29.892466 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42491a99-0437-4322-8d22-f28ae62e2f5c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1691 microversion: 2.1 time: 0.171780 Sep 22 12:34:29.893097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 325/662] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:29 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:30.551794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:30.554052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:30.562494 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:30.563351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:30.564008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:30.564751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:30.565305 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:30.565736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:30.600745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-94c0d7cb-a946-4417-b3b8-e7e5346d73b1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053319 Sep 22 12:34:30.601300 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 338/663] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:30 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:34:30.914848 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:30.915471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:30.922834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:30.923209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:30.923814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:30.924499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:30.924953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:30.925374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:31.072129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:31.080592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aef125e5-b67b-44c3-be6b-07aa19489314 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1691 microversion: 2.1 time: 0.169503 Sep 22 12:34:31.081089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 326/664] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:30 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:31.614039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:31.616179 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:31.622803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:31.623285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:31.623723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:31.624452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:31.624908 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:31.625334 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:31.655191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2933161a-a1aa-438d-9cf8-5acf481c53ac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045247 Sep 22 12:34:31.655744 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 339/665] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:31 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 12:34:32.104327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:32.104933 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:32.112104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:32.112682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:32.113367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:32.114126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:32.114648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:32.115140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:32.245720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:32.253590 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c9f43c00-6a83-4e12-a8eb-508162018c3a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1691 microversion: 2.1 time: 0.153309 Sep 22 12:34:32.254152 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 327/666] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:32 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:32.667794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:32.670008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:32.676441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:32.676925 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:32.677365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:32.678049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:32.678498 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:32.678919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:32.708642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-529abdeb-8599-4677-ab62-14bf564df422 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044825 Sep 22 12:34:32.709356 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 340/667] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:32 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:34:33.276547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:33.277179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:33.283475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:33.283954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:33.284428 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:33.285371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:33.285608 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:33.286067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:33.419028 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:33.426644 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d8778726-66af-49fb-83f3-9fca0d03ba69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1691 microversion: 2.1 time: 0.153941 Sep 22 12:34:33.427208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 328/668] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:33 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:33.721692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:33.723798 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:33.730912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:33.731386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:33.731818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:33.732532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:33.732981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:33.733397 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:33.763446 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f47330e0-7797-4a85-9558-a83bb302c16a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045750 Sep 22 12:34:33.764019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 341/669] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:33 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:34:34.451035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:34.451739 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:34.458240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.458803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.459306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.460080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.460547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.460971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.677867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:34.686212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-17582159-a8da-441f-bc78-d94606d1fca7 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1691 microversion: 2.1 time: 0.239518 Sep 22 12:34:34.686782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 329/670] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:34 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:34.776114 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:34.778348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:34.784732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.785281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.785801 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.786549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.787066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.787584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.817323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-071c8f32-50ad-49f8-ba76-ad1258450dd9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045220 Sep 22 12:34:34.817885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 342/671] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:34:34 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:34.909094 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:34.910110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:34.911478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4881b40d-864a-42ec-8c64-a1366dac5f05", "name": "network-vif-deleted", "tag": "76be057b-3ae6-473f-85db-c31a75400a6b"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:34.919753 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.920645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.921717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.922675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.923370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.924284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.928206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:34.928920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:34.929538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:34.946906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] Creating event network-vif-deleted:76be057b-3ae6-473f-85db-c31a75400a6b for instance 4881b40d-864a-42ec-8c64-a1366dac5f05 on hv-cinder-85646 Sep 22 12:34:34.954540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-39499145-e273-4184-bd94-c1c3604baa09 req-3c8b9bbb-a88b-44e3-9ac5-272012e3ae86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047892 Sep 22 12:34:34.955705 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 343/672] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:34.962565 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:35.073875 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3f53c768-e2a1-472a-afbf-60d6458965b8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 204 len: 0 microversion: 2.20 time: 0.169227 Sep 22 12:34:35.075252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 330/673] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 22 12:34:34 2022] DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 12:34:35.084159 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:35.084933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:35.092389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:35.093154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:35.093917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:35.095302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:35.095707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:35.096484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:35.236068 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:35.244373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:35.245801 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:35.246976 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e81c95da-6c49-4347-86ab-f093e619336e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.167560 Sep 22 12:34:35.247528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 344/674] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:35 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:35.709872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:35.710578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:35.717155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:35.717717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:35.718222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:35.718930 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:35.719383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:35.719808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:35.755979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:35.756286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:35.756768 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:35.757218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'fault' on Instance uuid 4881b40d-864a-42ec-8c64-a1366dac5f05 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:35.798199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:35.805890 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-478c3b9c-046c-4443-80e5-59ff86fdc03c tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1336 microversion: 2.1 time: 0.100590 Sep 22 12:34:35.806454 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 331/675] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:35 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:36.273074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:36.273604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:36.282351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:36.282823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:36.283282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:36.283987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:36.284475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:36.284895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:36.289041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:36.421658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:36.429768 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:36.431211 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:36.432354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c2baa41a-2dc6-4953-9846-9c4dc2ff0755 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.163207 Sep 22 12:34:36.432902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 345/676] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:36 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:36.829920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:36.830816 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:36.837630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:36.838184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:36.838620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:36.839361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:36.840363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:36.840789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:36.891491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:36.891975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:36.892448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:36.892892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'fault' on Instance uuid 4881b40d-864a-42ec-8c64-a1366dac5f05 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:36.935677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:36.939217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:36.944254 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4f2e6c16-210f-4fc2-9b86-d2ab2e52748b tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 200 len: 1336 microversion: 2.1 time: 0.118321 Sep 22 12:34:36.944840 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 332/677] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:36 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 1336 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:37.459529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:37.460196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:37.466568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:37.467168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:37.467613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:37.468375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:37.468825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:37.469243 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:37.945189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:37.960095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:37.961735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:37.963038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a99f0c14-0c22-417f-aea9-76d891f83b28 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1724 microversion: 2.20 time: 0.507535 Sep 22 12:34:37.969013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:37.970311 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 4881b40d-864a-42ec-8c64-a1366dac5f05] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:37.975128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 346/678] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:37 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1724 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:37.982433 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:37.984022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:37.984956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:37.985965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:37.986731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:37.987680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.008358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] HTTP exception thrown: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Request method failure captured: Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 HTTP/1.1 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUcj0K8tQrrX6-a54Yi10L4gYKD9mDkoaz30c9nagl9Z3VctGf0yaEEIAZIGHsEfToadDMBXHS0GmzzOm0aPxHFOxjdvgVHNLxM0WAO7Yb-ylj_f0MZhSnDRojLpuizq7LVpG7hXZAxfVHN02J9sVXnuwRZ4826fjZLv1h0rqZDX4I Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:38.010325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb62ca26c4fe47deb0a21511a96e6403"}]}] Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 0847f00afbde44068fcf1cedbce24be5 Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. Sep 22 12:34:38.011931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '4881b40d-864a-42ec-8c64-a1366dac5f05'} Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:38.012968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. Sep 22 12:34:38.014458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:38.016707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Returning 404 to user: Instance 4881b40d-864a-42ec-8c64-a1366dac5f05 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:38.018321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21f928e0-461b-4ccd-ae14-d845c5140d71 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05" status: 404 len: 111 microversion: 2.1 time: 0.055075 Sep 22 12:34:38.019472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 333/679] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:37 2022] GET /compute/v2.1/servers/4881b40d-864a-42ec-8c64-a1366dac5f05 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:34:38.031596 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a33773f8-c538-432e-8c9d-5c4515e2d777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '.version_select at 0x7f1079b35b80>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:38.051949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a33773f8-c538-432e-8c9d-5c4515e2d777 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779644563" status: 202 len: 0 microversion: 2.1 time: 0.024546 Sep 22 12:34:38.052569 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 347/680] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 22 12:34:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1779644563 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:34:38.195671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:38.199130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:38.209432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.209432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.209432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.210277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.210277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.210743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.254746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1a12196a-ae8e-45c7-bb60-1f0ad355ffe1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063901 Sep 22 12:34:38.255648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 334/681] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:38 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:34:38.319452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:38.319951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:38.325891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.326371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.326799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.328022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.328502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.328921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.356173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:38.437158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-423be1ae-05b0-4b22-843d-a18175270775 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 204 len: 0 microversion: 2.1 time: 0.120736 Sep 22 12:34:38.438013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 348/682] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:38 2022] DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:38.448438 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:38.449796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:38.456582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.457190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.457720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.458644 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.459326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.459829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.701491 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:38.711280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb8c55e5-1b40-41dd-a3ce-faa06cbef35d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1675 microversion: 2.1 time: 0.266490 Sep 22 12:34:38.712247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 335/683] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:38 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:38.730887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97c51-b54b-48e0-9929-cc535246eb97", "name": "network-vif-deleted", "tag": "c01d78fa-cbfb-4c80-a00f-e7a90be2757f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:38.742110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:38.742839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:38.743644 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:38.755207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] Creating event network-vif-deleted:c01d78fa-cbfb-4c80-a00f-e7a90be2757f for instance 15c97c51-b54b-48e0-9929-cc535246eb97 on hv-cinder-85646 Sep 22 12:34:38.760281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-522f2a5b-4870-44e6-a171-5ab52de7253a req-64b8d01b-d9a4-4779-b656-800951cded52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101573 Sep 22 12:34:38.760993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 349/684] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:38.995956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:38.997274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:39.004858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:39.006436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:39.006947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:39.007726 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:39.008260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:39.008939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:39.080894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:39.089114 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:39.090587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:39.091751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7a225d82-7249-4618-b789-ce597f6d48a7 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1657 microversion: 2.20 time: 0.100596 Sep 22 12:34:39.092317 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 336/685] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:38 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:39.735605 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:39.736338 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:39.744620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:39.745107 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:39.745552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:39.746266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:39.746785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:39.747219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:39.934714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:39.943253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f49c4504-d2d1-489a-b43a-363cc83c6853 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1675 microversion: 2.1 time: 0.212367 Sep 22 12:34:39.951453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 350/686] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:39 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:40.121298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:40.122008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:40.130927 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:40.132689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:40.139499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:40.140312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:40.140850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:40.141319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:40.228696 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:40.239225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:40.240827 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:40.242224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae79a1ff-81ff-4aea-ac77-2dbf5fd0578f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 200 len: 1657 microversion: 2.20 time: 0.128143 Sep 22 12:34:40.243007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 337/687] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:40 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 1657 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:34:40.966782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:40.967389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:40.971037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:40.974680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:40.975169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:40.975826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:40.976642 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:40.977202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:40.977926 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.166891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:41.174820 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dd7c052d-a7c2-413a-8e8f-9d5528ac2958 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1675 microversion: 2.1 time: 0.211787 Sep 22 12:34:41.175373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 351/688] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:40 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1675 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:41.232705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:41.233246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:41.240009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.240530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.240964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.241656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.242107 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.242529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.270770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:41.271951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:41.275511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:41.283486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.284162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.284696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.285406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.285902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.286286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.301355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 HTTP/1.1 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:34:41.303139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:34:41.304770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '15c97c51-b54b-48e0-9929-cc535246eb97'} Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:41.305602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:34:41.306796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:41.307844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:41.307844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-56cdcaf3-0f0e-466f-9029-5a8ce9eda83b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 404 len: 111 microversion: 2.20 time: 0.037844 Sep 22 12:34:41.307844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 352/689] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:41 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 22 12:34:41.313996 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-01bd6da2-0d53-4d00-9013-6c2d5b6d10f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '.version_select at 0x7f1079a49670>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:41.335081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-01bd6da2-0d53-4d00-9013-6c2d5b6d10f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728861724" status: 204 len: 0 microversion: 2.20 time: 0.025253 Sep 22 12:34:41.335656 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 353/690] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Sep 22 12:34:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728861724 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 22 12:34:41.375720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-387461d4-eaa9-4869-ac30-7e01ca54652f tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 204 len: 0 microversion: 2.1 time: 0.146579 Sep 22 12:34:41.376883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 338/691] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:41 2022] DELETE /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:41.385621 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:41.386697 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:41.393248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.393813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.394464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.395384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.395931 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.396592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.642544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:41.652409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e0c4bfd0-b4d5-4795-92b2-38740aeae8e6 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1508 microversion: 2.1 time: 0.271275 Sep 22 12:34:41.666967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 354/692] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:41 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:41.675889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ee64bd-305d-44e5-a1b7-00f4ef55cf64", "name": "network-vif-deleted", "tag": "e2f4672c-6d5a-4ebe-b44f-8980103a38bf"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:41.689157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.690050 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.690578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.708461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] Creating event network-vif-deleted:e2f4672c-6d5a-4ebe-b44f-8980103a38bf for instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 on hv-cinder-85646 Sep 22 12:34:41.715281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-098b08d4-1e2c-46e9-a8d3-a37473b3866d req-3f3319ae-1d4b-4bf6-97ce-c4fbd30fc64f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044408 Sep 22 12:34:41.716370 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 355/693] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:41.841542 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:41.842225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:41.848731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.849325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.849839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.850734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:41.851270 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:41.851783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:41.883600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-578e9fb3-fbfe-4165-be7c-5e3e041fc449 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/ips" status: 200 len: 149 microversion: 2.1 time: 0.386425 Sep 22 12:34:41.884252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 339/694] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:34:41 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/ips => generated 149 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:42.105855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e5596783-aa01-421e-b108-e3d228726950 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: .version_select at 0x7f1079a494c0>, body: {"keypair": {"name": "tempest-keypair-1708258262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Z7z7shEZ3hORIPEEowi/m1UbkaoFwJSeghN4DCeLDUwqtUmCx6WVGnYT8G3U93XjF3Psr5olkRih9wZsl9Ra3XGXzSsByEdGmu3MhNb2X2QJeyUVQAmG19LX8ywegcQ=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:42.125295 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e5596783-aa01-421e-b108-e3d228726950 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for project 553395befb8f4c958d34b7dffb2317e7. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:34:42.129442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-e5596783-aa01-421e-b108-e3d228726950 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for user 262e5327ba144a6287fef6dd6293f886 and project 553395befb8f4c958d34b7dffb2317e7. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:34:42.158175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e5596783-aa01-421e-b108-e3d228726950 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057307 Sep 22 12:34:42.159436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 356/695] 10.222.0.33 () {62 vars in 1200 bytes} [Thu Sep 22 12:34:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 22 12:34:42.199477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:42.200606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:42.214602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:42.215092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:42.215524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:42.216219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:42.216693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:42.217255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:42.309904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:42.320193 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c89d569-8894-4972-931b-aa536ba051c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1607 microversion: 2.1 time: 0.125405 Sep 22 12:34:42.320987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 340/696] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:42 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1607 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:42.680503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:42.681355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:42.688077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:42.688759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:42.689711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:42.690526 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:42.691124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:42.691714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:42.830744 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:42.838459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0fdcac9f-1f14-4281-b39e-22a384ef1544 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1508 microversion: 2.1 time: 0.162580 Sep 22 12:34:42.839015 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 357/697] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:42 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:43.285287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2b572d-33fb-41bb-9c9c-6b2cf3672950"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:43.287824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:43.294430 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.295028 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.296225 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.297134 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.297692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.298211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.343403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:43.344009 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:43.352982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.353471 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.353902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.354602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.355058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.355482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.397078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.397999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.399559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.400181 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lazy-loading 'fault' on Instance uuid 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:43.466921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:43.474879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9ce1ff17-9abf-4fe6-9634-13d138b43912 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 200 len: 1327 microversion: 2.1 time: 0.135281 Sep 22 12:34:43.475445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 358/698] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:43 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:43.712512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7daded7c-af34-42ed-837a-d89ae4b9addc tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430709 Sep 22 12:34:43.714378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 341/699] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:34:43 2022] POST /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments => generated 194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:43.833444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "788e8c2c-8b83-46fe-8728-92c6b755c9c8", "name": "network-vif-deleted", "tag": "a1cada3c-6838-41ff-aa19-94a5eda38089"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:43.845187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.845750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.846137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.860335 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] Creating event network-vif-deleted:a1cada3c-6838-41ff-aa19-94a5eda38089 for instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 on hv-cinder-85646 Sep 22 12:34:43.865677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:43.868344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:43.869992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-16772dc6-59ac-44d9-85a1-8d05856f2d11 req-93871880-639d-4633-81d0-6e72606988ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041250 Sep 22 12:34:43.874914 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 359/700] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:43.887513 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.888327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.888852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.889607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:43.890069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:43.890492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:43.957044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2073690789", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08232c3f-2666-43a1-afb2-c887234ff0ea"}], "security_groups": [{"name": "tempest-securitygroup--2037900123"}], "key_name": "tempest-keypair-1708258262", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:43.987298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:43.997885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aca37a03-86a8-4672-a0d6-456de09df2d8 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 200 len: 1292 microversion: 2.1 time: 0.138774 Sep 22 12:34:43.998482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 342/701] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:43 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:44.070147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] validate_networks() for [('08232c3f-2666-43a1-afb2-c887234ff0ea', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:34:44.499021 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:44.499891 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:44.506725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:44.507222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:44.507669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:44.508396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:44.508856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:44.509287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:44.523375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 HTTP/1.1 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:44.525068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:34:44.526649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '05ee64bd-305d-44e5-a1b7-00f4ef55cf64'} Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:44.527530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:34:44.528982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:44.530996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:44.530996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77f4ab82-3ed5-41d5-919c-ded5ad2cfe42 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 404 len: 111 microversion: 2.1 time: 0.031507 Sep 22 12:34:44.530996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 343/702] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:44 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:34:44.535905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-734b47c2-508b-4a93-8d6b-4012a67159f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '.version_select at 0x7f1079a6f550>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:44.550649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:34:44.551116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:34:44.551710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:34:44.552229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:34:44.552809 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:34:44.560235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-734b47c2-508b-4a93-8d6b-4012a67159f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-633784274" status: 202 len: 0 microversion: 2.1 time: 0.027882 Sep 22 12:34:44.561056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 344/703] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 22 12:34:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-633784274 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:34:44.563900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:44.564508 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:44.565022 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:44.565841 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:44.566369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:44.566890 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:44.585786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for project 553395befb8f4c958d34b7dffb2317e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:34:44.589772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Getting quotas for user 262e5327ba144a6287fef6dd6293f886 and project 553395befb8f4c958d34b7dffb2317e7. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:34:44.600770 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:34:44.603414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:34:44.658031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-75b55f45-d907-45cf-874c-9820373a7dac tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.705835 Sep 22 12:34:44.658840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 360/704] 10.222.0.33 () {62 vars in 1188 bytes} [Thu Sep 22 12:34:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 22 12:34:44.669717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:44.670581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:44.976182 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:44.986005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:44.987460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:44.988618 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec795491-ecd7-4160-9a81-a6d7fb2f2eff tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1282 microversion: 2.20 time: 0.322688 Sep 22 12:34:44.989560 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 345/705] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:44 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1282 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:34:45.020465 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:45.021263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: 788e8c2c-8b83-46fe-8728-92c6b755c9c8] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:45.028604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.029128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.029554 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.030483 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.031027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.031762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.048267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] HTTP exception thrown: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Request method failure captured: Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 HTTP/1.1 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUcj0K8tQrrX6-a54Yi10L4gYKD9mDkoaz30c9nagl9Z3VctGf0yaEEIAZIGHsEfToadDMBXHS0GmzzOm0aPxHFOxjdvgVHNLxM0WAO7Yb-ylj_f0MZhSnDRojLpuizq7LVpG7hXZAxfVHN02J9sVXnuwRZ4826fjZLv1h0rqZDX4I Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:34:45.049945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb62ca26c4fe47deb0a21511a96e6403"}]}] Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 0847f00afbde44068fcf1cedbce24be5 Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. Sep 22 12:34:45.051302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '788e8c2c-8b83-46fe-8728-92c6b755c9c8'} Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:45.052060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. Sep 22 12:34:45.053278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:45.056413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Returning 404 to user: Instance 788e8c2c-8b83-46fe-8728-92c6b755c9c8 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:45.056413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c81bc749-a1bc-47f2-ab31-2ca08aaf0b17 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8" status: 404 len: 111 microversion: 2.1 time: 0.034824 Sep 22 12:34:45.056413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 361/706] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:45 2022] GET /compute/v2.1/servers/788e8c2c-8b83-46fe-8728-92c6b755c9c8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:34:45.064075 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:45.065743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:45.074643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.075342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.076357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.077723 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.078837 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.079285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.114007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:45.200215 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7527b27-1650-4f54-b17f-7e423bde15ce tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 204 len: 0 microversion: 2.1 time: 0.140546 Sep 22 12:34:45.204419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 346/707] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:45 2022] DELETE /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:45.209601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:45.210438 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:45.217940 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.218421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.218851 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.219544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:45.220172 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:45.220774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:45.316363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1f04f7c5-b9d3-4d94-b991-fbb4ea4892bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: .version_select at 0x7f1079ae6310>, body: {"keypair": {"name": "tempest-keypair-893766943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGEEeZleYZsriQoCbHoboi21RRYja6UyVO3NXjOL4EW2lSO1f6WPWStTFwH6XDgablc6yrkRnvVs80rUZc6+afGQjy5GCDcoV1OZ6ncM1vfGDM6+es1eNfB+2ScNO4hIA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:45.331585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-1f04f7c5-b9d3-4d94-b991-fbb4ea4892bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for project 89fe74d1d646452e83cb93420766c0a2. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:34:45.335435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-1f04f7c5-b9d3-4d94-b991-fbb4ea4892bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for user 49c772b0c2bb49a4ab4048d980bd20a8 and project 89fe74d1d646452e83cb93420766c0a2. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:34:45.357836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1f04f7c5-b9d3-4d94-b991-fbb4ea4892bd tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046339 Sep 22 12:34:45.359100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 347/708] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:34:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:45.363790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:45.372051 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-21f1314e-5689-43bc-94ce-37c7173d5740 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.166538 Sep 22 12:34:45.372713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 362/709] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:45 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:46.014627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:46.015895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:46.022669 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:46.023337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:46.023782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:46.024543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:46.025290 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:46.025868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:46.103883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:46.112271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:46.113745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:46.114850 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e6c70db1-c0df-4665-9539-bbf59f1ba476 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1286 microversion: 2.20 time: 0.104498 Sep 22 12:34:46.115402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 348/710] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:46 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:46.395938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:46.396518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:46.403185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:46.403676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:46.404115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:46.404837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:46.405315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:46.405723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:46.539575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:46.547951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4f96a6e2-c753-4158-9701-d3c61d32ca4a tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.156195 Sep 22 12:34:46.548538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 363/711] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:46 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:46.603306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1226725489", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa4f03ac-0d51-4ef1-9086-3b2b84cb717e"}], "security_groups": [{"name": "tempest-securitygroup--595969689"}], "key_name": "tempest-keypair-893766943", "user_data": "}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:46.705266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] validate_networks() for [('fa4f03ac-0d51-4ef1-9086-3b2b84cb717e', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:34:47.114525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:34:47.115084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:34:47.115393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:34:47.115793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:34:47.116232 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:34:47.119303 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:47.126612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.127151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.127578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.128316 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.128768 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.129185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.139629 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:47.140492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:47.146414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.146896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.147324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.148021 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.148503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.148844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for project 89fe74d1d646452e83cb93420766c0a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:34:47.148961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.152860 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Getting quotas for user 49c772b0c2bb49a4ab4048d980bd20a8 and project 89fe74d1d646452e83cb93420766c0a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:34:47.164725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:34:47.167071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:34:47.211315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:47.216286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c7dd8de5-0931-4609-9366-9096efc0a902 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617407 Sep 22 12:34:47.220047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 349/712] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:34:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:34:47.224838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:47.226481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:47.227912 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ffc5706a-6c1b-49cc-b778-9c807a0311db tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1286 microversion: 2.20 time: 0.091936 Sep 22 12:34:47.228752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 364/713] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:47 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1286 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:34:47.229281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1624ada1-e1cd-45f6-a030-770f837f8fc3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:47.229904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1624ada1-e1cd-45f6-a030-770f837f8fc3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:47.284229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1624ada1-e1cd-45f6-a030-770f837f8fc3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:47.292198 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1624ada1-e1cd-45f6-a030-770f837f8fc3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1237 microversion: 2.1 time: 0.066695 Sep 22 12:34:47.293266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 350/714] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:47 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:47.572643 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:47.573264 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:47.581086 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.581708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.582182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.583219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:47.583756 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:47.584195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:47.718854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:47.726655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9d3fed99-b3c9-45fc-93b7-5355a0770f69 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1521 microversion: 2.1 time: 0.158789 Sep 22 12:34:47.727222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 365/715] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:47 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:48.256245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:48.256887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:48.263259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.263742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.264181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.264940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.265393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.265819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.269723 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:48.315878 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:48.316560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:48.322821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.323294 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.323726 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.324454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.324909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.325331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.353318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:48.363335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:48.364977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:48.366082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8cc2e6ec-a1e6-4715-8408-46bab216f4f5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1278 microversion: 2.20 time: 0.113889 Sep 22 12:34:48.366658 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 351/716] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:48 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1278 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:48.400417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:48.404076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:48.409757 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4cbedde9-06a1-44ce-b616-d42510ccae85 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1289 microversion: 2.1 time: 0.098587 Sep 22 12:34:48.410318 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 366/717] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:48 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:48.749972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:48.750599 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:48.758003 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.760996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.761475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.762220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.762688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.763127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.813925 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f8b6d4-4a92-4a94-a7d2-23435c651c4d", "name": "network-vif-deleted", "tag": "59f4c935-e132-4169-a0e6-2552ac665c8d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:48.825780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:48.826373 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:48.827425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:48.839526 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] Creating event network-vif-deleted:59f4c935-e132-4169-a0e6-2552ac665c8d for instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d on hv-cinder-85646 Sep 22 12:34:48.845539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-dd107d3c-9c42-4d75-8f48-a50daa1201ac req-3bf0a2c4-b056-4f17-b26c-f3c5529930fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039759 Sep 22 12:34:48.846217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 367/718] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:48.847024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:48.856765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60d4b994-799c-4ca5-9c8d-8bce6ec322b9 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1479 microversion: 2.1 time: 0.109839 Sep 22 12:34:48.857340 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 352/719] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:48 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1479 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:49.391623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:49.392417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:49.398482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.398973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.399427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.400110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.400594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.401019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.433448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:49.434052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:49.440799 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.441280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.441710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.442402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.442839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.443260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.497730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:49.505979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:49.507443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:49.508594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-94ffd9af-82a8-44ba-bfc1-e92efe54f8f6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1334 microversion: 2.20 time: 0.121348 Sep 22 12:34:49.509160 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 368/720] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:49 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1334 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:49.529273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:49.537952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23afaaee-acd7-4efc-bec2-25d883290e7b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1295 microversion: 2.1 time: 0.108621 Sep 22 12:34:49.538538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 353/721] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:49 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:49.881430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:49.882046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:49.889112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.890235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.890674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.891379 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.891832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.892260 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.932675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:49.933168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:49.933607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:49.934054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lazy-loading 'fault' on Instance uuid e0f8b6d4-4a92-4a94-a7d2-23435c651c4d {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:50.003080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0847f00afbde44068fcf1cedbce24be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb62ca26c4fe47deb0a21511a96e6403', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:50.022703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-20646df8-bff3-42b8-84f9-21c9fdb10158 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 200 len: 1311 microversion: 2.1 time: 0.145597 Sep 22 12:34:50.029767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 369/722] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:49 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 1311 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:50.537397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:50.538760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:50.546824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:50.547344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:50.547786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:50.548520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:50.548978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:50.549407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:50.562111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:50.562869 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:50.571826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:50.572457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:50.573000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:50.574052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:50.574542 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:50.574967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:50.693921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:50.702529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:50.703953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:50.705072 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f9fc0e9e-426e-40b4-9b4e-dc7375c2287b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1340 microversion: 2.20 time: 0.173780 Sep 22 12:34:50.705621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 354/723] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:50 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1340 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:50.923400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:50.931781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fee953dc-675d-4fbe-95f2-d3973b768aa7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.374853 Sep 22 12:34:50.932364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 370/724] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:50 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:51.054294 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:51.054908 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] [instance: e0f8b6d4-4a92-4a94-a7d2-23435c651c4d] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.060777 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.061261 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.061697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.062389 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.062839 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.063452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.079774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] HTTP exception thrown: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Request method failure captured: Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d HTTP/1.1 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUcj0K8tQrrX6-a54Yi10L4gYKD9mDkoaz30c9nagl9Z3VctGf0yaEEIAZIGHsEfToadDMBXHS0GmzzOm0aPxHFOxjdvgVHNLxM0WAO7Yb-ylj_f0MZhSnDRojLpuizq7LVpG7hXZAxfVHN02J9sVXnuwRZ4826fjZLv1h0rqZDX4I Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:51.081449 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/fb62ca26c4fe47deb0a21511a96e6403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_fb62ca26c4fe47deb0a21511a96e6403"}]}] Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: fb62ca26c4fe47deb0a21511a96e6403 Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696298670 Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 0847f00afbde44068fcf1cedbce24be5 Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696298670-project Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. Sep 22 12:34:51.082983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'e0f8b6d4-4a92-4a94-a7d2-23435c651c4d'} Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:51.083843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. Sep 22 12:34:51.085707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.087333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] Returning 404 to user: Instance e0f8b6d4-4a92-4a94-a7d2-23435c651c4d could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:51.087333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-276f672b-7bd1-4d95-ad1d-94009e192d32 tempest-ServerRescueNegativeTestJSON-1696298670 tempest-ServerRescueNegativeTestJSON-1696298670-project] 10.222.0.33 "GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d" status: 404 len: 111 microversion: 2.1 time: 0.032401 Sep 22 12:34:51.087333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 355/725] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:51 2022] GET /compute/v2.1/servers/e0f8b6d4-4a92-4a94-a7d2-23435c651c4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:34:51.276372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b5457e-796c-4b69-9edd-b2b23758d503", "tag": "ec8f30d7-2581-41aa-a517-0d4941004617"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:51.289827 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.290383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.290910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.310600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] Creating event network-changed:ec8f30d7-2581-41aa-a517-0d4941004617 for instance 83b5457e-796c-4b69-9edd-b2b23758d503 on hv-cinder-85646 Sep 22 12:34:51.319142 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-a9ebe3ed-6f8b-4940-9ceb-52463f708438 req-eac35cf9-0c52-45f6-a187-9d12938748f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046398 Sep 22 12:34:51.320624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 371/726] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:51.417551 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2b572d-33fb-41bb-9c9c-6b2cf3672950"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:51.420015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.426124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.426602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.427034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.427722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.428173 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.428743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.514168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments HTTP/1.1 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 74 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:51.517646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {"volumeAttachment": {"volumeId": "ab2b572d-33fb-41bb-9c9c-6b2cf3672950"}} Sep 22 12:34:51.519009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'server_id': '71cc8e1d-1561-4c72-a891-28be6d887da5', 'body': {'volumeAttachment': {'volumeId': 'ab2b572d-33fb-41bb-9c9c-6b2cf3672950'}}} Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.519881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:51.521259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:51.522773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:51.522773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:51.522773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:51.522773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 Sep 22 12:34:51.522773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:51.524499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 400 to user: Invalid volume: volume ab2b572d-33fb-41bb-9c9c-6b2cf3672950 is already attached to instances: 71cc8e1d-1561-4c72-a891-28be6d887da5 {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:51.525530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-191dc6f9-d49d-4e45-86ed-65ac7dbaa590 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112417 Sep 22 12:34:51.526103 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 356/727] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:34:51 2022] POST /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:34:51.610947 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:51.611778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.619447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.619935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.620416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.621119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.621562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.622073 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.732071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:51.732705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.735899 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'services' on Instance uuid 71cc8e1d-1561-4c72-a891-28be6d887da5 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:51.741554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.742245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.742867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.744046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.750654 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.751279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.825786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ca1a7063-46ff-44bc-8f7a-b1f50ad2188b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments/ab2b572d-33fb-41bb-9c9c-6b2cf3672950" status: 202 len: 0 microversion: 2.1 time: 0.218961 Sep 22 12:34:51.826389 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 372/728] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:34:51 2022] DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments/ab2b572d-33fb-41bb-9c9c-6b2cf3672950 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:34:51.836406 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:51.838735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.846198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.846900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.847562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.848391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.849054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.849694 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.909083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-21c337d0-aacb-4825-8a62-0a94ace9c370 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078004 Sep 22 12:34:51.916431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 373/729] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:51 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:51.955303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:51.957057 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:51.964088 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.965350 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.966006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:51.968100 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:51.968618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:51.969070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:52.369352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:52.379038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:52.380888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:52.382937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ab61fcc-2dea-457e-bf96-b504ec60212c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.655216 Sep 22 12:34:52.392589 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 357/730] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:51 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:52.507858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:52.516344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-10f6b3ab-0a0e-4b20-ad7b-c65e6c65222a tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.565411 Sep 22 12:34:52.529451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 374/731] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:51 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:52.923092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:52.925370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:52.932925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:52.933649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:52.934270 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:52.935146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:52.935771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:52.936765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:52.969074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-59645238-21b9-4eb3-95b7-4a203561b0c0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049897 Sep 22 12:34:52.970306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 358/732] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:52 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:53.351874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:53.372857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.373353 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.374549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.386832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] Creating event network-changed:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:34:53.392033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-65e89aea-be74-48ef-b633-e4fcf23605e7 req-a2ac8641-22c0-48bc-b932-9f75243b74ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Sep 22 12:34:53.392669 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 375/733] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:34:53.407911 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:53.408896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:53.415307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.416098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.416809 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.417774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.418337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.418888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.539722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:53.540959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:53.550552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.551612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.552357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.553409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.554328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.555607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.847406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:53.856517 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:53.858632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:53.859756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-644a77e8-75ac-4fa5-876f-04e65de015f4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.455865 Sep 22 12:34:53.860377 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 359/734] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:53 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:53.947086 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:53.956765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-60e7d433-8f7c-4392-bae5-664d72cf3eba tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.421182 Sep 22 12:34:53.957349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 376/735] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:53 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:53.982357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:53.985549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:53.992016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.992564 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.993192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:53.994065 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:53.994526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:53.994945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.026944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42ba2bb9-826d-4aac-8f8e-c4e9c81b4e22 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048580 Sep 22 12:34:54.027670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 360/736] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:34:53 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:34:54.105876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:54.106575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:54.113731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.115730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.116366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.117239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.117841 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.118422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.163708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:34:54.364417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-573197d4-536f-4639-a272-b5d96892010a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 204 len: 0 microversion: 2.1 time: 0.260170 Sep 22 12:34:54.366742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 377/737] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:34:54 2022] DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:34:54.374129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:54.374748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:54.380760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.381264 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.381695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.382571 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.383014 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.383434 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.523062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:54.531212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-38396af5-3cdf-419c-ace2-bfc4f6eb0cab tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1680 microversion: 2.1 time: 0.161354 Sep 22 12:34:54.531852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 361/738] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:54 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:54.886931 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:54.887667 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:54.891116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:54.891772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=10 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:54.896558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.897113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.897604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.898411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.898944 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.899370 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.980628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:54.981326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:54.988032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.988662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.989124 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:54.989871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:54.990389 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:54.990835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:55.115785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:55.124812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:55.126265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:55.127375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4625268c-7332-4a42-adb1-4699c5a6fb38 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.244744 Sep 22 12:34:55.127934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 378/739] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:54 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:55.206502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:55.214270 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73845b82-5531-4f4a-96ba-afd1bf7f6bcf tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.237846 Sep 22 12:34:55.214906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 362/740] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:54 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:55.554399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:55.555139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:55.562247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:55.562942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:55.563371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:55.564071 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:55.564550 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:55.565005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:55.710762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:55.719263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c373178f-2d06-4007-a843-5887b0a696b0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1680 microversion: 2.1 time: 0.169006 Sep 22 12:34:55.719823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 379/741] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:55 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:56.003407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec70b895-47a4-42a3-a572-3034579bf19f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Action: 'create', calling method: .version_select at 0x7f1079a6f430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291421971", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec70b895-47a4-42a3-a572-3034579bf19f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 122 Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:56.014808 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291421971", "metadata": {"Type": "work"}}} Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:34:56.016450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1291421971', 'metadata': {'Type': 'work'}}}} Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '#$%' Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.017393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 12:34:56.019029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 12:34:56.020218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 22 12:34:56.020218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.020218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ec70b895-47a4-42a3-a572-3034579bf19f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.020218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ec70b895-47a4-42a3-a572-3034579bf19f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.123860 Sep 22 12:34:56.020218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 363/742] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 22 12:34:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:34:56.027302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2f86b5a8-77e9-4957-b4c5-1d3ea290fe1b tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Action: 'create', calling method: .version_select at 0x7f1079a01310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2116593054", "metadata": {"Type": "work"}}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2f86b5a8-77e9-4957-b4c5-1d3ea290fe1b tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 120 Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:34:56.032676 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2116593054", "metadata": {"Type": "work"}}} Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: Sep 22 12:34:56.034197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2116593054', 'metadata': {'Type': 'work'}}}} Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise error Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi '0' Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.035008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 12:34:56.036323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 12:34:56.037466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 22 12:34:56.037466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.037466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2f86b5a8-77e9-4957-b4c5-1d3ea290fe1b tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.037466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2f86b5a8-77e9-4957-b4c5-1d3ea290fe1b tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010613 Sep 22 12:34:56.037466 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 380/743] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 22 12:34:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:34:56.043702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4a2116b-a807-40e8-ba68-f246d28487ff tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Action: 'create', calling method: .version_select at 0x7f1079a37820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352818618", "metadata": {"Type": "work"}}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4a2116b-a807-40e8-ba68-f246d28487ff tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 119 Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:56.048609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352818618", "metadata": {"Type": "work"}}} Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:34:56.050024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1352818618', 'metadata': {'Type': 'work'}}}} Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise error Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi '' Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.051084 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 22 12:34:56.052752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 22 12:34:56.053926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 22 12:34:56.053926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.053926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a4a2116b-a807-40e8-ba68-f246d28487ff tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.053926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a4a2116b-a807-40e8-ba68-f246d28487ff tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010288 Sep 22 12:34:56.053926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 364/744] 10.222.0.33 () {60 vars in 1156 bytes} [Thu Sep 22 12:34:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 22 12:34:56.060600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5131a90d-7afa-404c-af1d-3f0e45bd1676 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Calling method '.version_select at 0x7f1079a3f9d0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.089329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-5131a90d-7afa-404c-af1d-3f0e45bd1676 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] HTTP exception thrown: Volume tempest-invalid-1616548550 could not be found. Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5131a90d-7afa-404c-af1d-3f0e45bd1676 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1616548550 HTTP/1.1 Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:34:56.093170 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Volume tempest-invalid-1616548550 could not be found. Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'tempest-invalid-1616548550'} Sep 22 12:34:56.094763 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1616548550 could not be found. (HTTP 404) (Request-ID: req-0ca596f6-69db-4ea3-8eb2-6ac2ca2cadf7) Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.096081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:34:56.097360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1616548550 could not be found. Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:56.098519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1616548550 could not be found. Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1616548550 could not be found. Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5131a90d-7afa-404c-af1d-3f0e45bd1676 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 404 to user: Volume tempest-invalid-1616548550 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5131a90d-7afa-404c-af1d-3f0e45bd1676 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1616548550" status: 404 len: 99 microversion: 2.1 time: 0.038299 Sep 22 12:34:56.100888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 381/745] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 22 12:34:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1616548550 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 22 12:34:56.104283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d16e8e4f-e69d-4fcb-88d8-8acba056a521 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004018 Sep 22 12:34:56.104802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 365/746] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Sep 22 12:34:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 22 12:34:56.117459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5bc9f552-d157-48c8-8b85-73ab1d47aae2 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003897 Sep 22 12:34:56.117953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 382/747] 10.222.0.33 () {58 vars in 1137 bytes} [Thu Sep 22 12:34:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 22 12:34:56.126642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a85459d7-225f-42a0-9b53-d27d6a544524 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Calling method '.version_select at 0x7f1079a6fee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.154127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a85459d7-225f-42a0-9b53-d27d6a544524 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] HTTP exception thrown: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a85459d7-225f-42a0-9b53-d27d6a544524 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/f7470251-00a4-4199-9af5-d8023df0a220 HTTP/1.1 Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:56.156620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'f7470251-00a4-4199-9af5-d8023df0a220'} Sep 22 12:34:56.158145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. (HTTP 404) (Request-ID: req-091f367d-6924-4c10-9da8-a5d947376acc) Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.159231 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:34:56.160569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 12:34:56.161900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. Sep 22 12:34:56.163183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.163988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.163988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:56.163988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.163988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.166617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:56.166617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.171164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a85459d7-225f-42a0-9b53-d27d6a544524 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 404 to user: Volume f7470251-00a4-4199-9af5-d8023df0a220 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.171360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.171360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:56.171517 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a85459d7-225f-42a0-9b53-d27d6a544524 tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f7470251-00a4-4199-9af5-d8023df0a220" status: 404 len: 109 microversion: 2.1 time: 0.043219 Sep 22 12:34:56.171517 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 366/748] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:34:56 2022] DELETE /compute/v2.1/os-volumes/f7470251-00a4-4199-9af5-d8023df0a220 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:34:56.177153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-625a991a-92c1-4a09-989b-3152e6661f7f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Calling method '.version_select at 0x7f1079a6f160>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.205131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-625a991a-92c1-4a09-989b-3152e6661f7f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] HTTP exception thrown: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-625a991a-92c1-4a09-989b-3152e6661f7f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Request method failure captured: Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/67286d2e-8be5-4534-a79f-7edea74899a8 HTTP/1.1 Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFZvoFPmXdoUC3IzQzgVt9SWObTfMBw2-pYMJKTaAy6R6pSQTrP7JEHChcCaA-QcuKsgsjqlERQTISP7LYLep-VruDtfRzq6rDEkOuQrUYHSnUHflraIMpbfKjtEwvSAwZFQ1wFxyrd-VlbteqnuZR6b3VQg95DypaBgFkdE5tY795Y Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:34:56.207037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77edb8cdc8294a72aaa2c3dbc5fe88dd"}]}] Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 77edb8cdc8294a72aaa2c3dbc5fe88dd Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesNegativeTest-1495078448 Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 5801b6cdf61c4264b3a7839dfa94064a Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesNegativeTest-1495078448-project Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '67286d2e-8be5-4534-a79f-7edea74899a8'} Sep 22 12:34:56.208592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. (HTTP 404) (Request-ID: req-952f1b0d-2708-4dff-bd61-b7f2d7e5749a) Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.209504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:34:56.210668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 12:34:56.211761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-625a991a-92c1-4a09-989b-3152e6661f7f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] Returning 404 to user: Volume 67286d2e-8be5-4534-a79f-7edea74899a8 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:34:56.216978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-625a991a-92c1-4a09-989b-3152e6661f7f tempest-VolumesNegativeTest-1495078448 tempest-VolumesNegativeTest-1495078448-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/67286d2e-8be5-4534-a79f-7edea74899a8" status: 404 len: 109 microversion: 2.1 time: 0.035964 Sep 22 12:34:56.218802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 367/749] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:34:56 2022] GET /compute/v2.1/os-volumes/67286d2e-8be5-4534-a79f-7edea74899a8 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:34:56.238139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.238859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:56.246642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.247312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.247754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:56.249244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.249708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.250130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:56.338842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:56.347999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:56.349464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:56.350575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8ca2fc2c-023e-48d3-b4c9-6c6f0de316d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.198254 Sep 22 12:34:56.351134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 383/750] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:56 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:34:56.408337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:56.416517 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9d44209c-46cd-424b-a598-9bd1fca439e1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.183215 Sep 22 12:34:56.417157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 368/751] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:56 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:56.742851 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:56.743471 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:56.749730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.750212 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.750645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:56.751330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:56.751777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:56.752193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:57.120653 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:57.129156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-548b7824-429e-4339-bab3-fb13727059f4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1680 microversion: 2.1 time: 0.390044 Sep 22 12:34:57.129728 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 384/752] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:56 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1680 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:57.376908 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:57.377864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:57.381375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:57.382180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=14 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:57.388279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:57.388958 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:57.390166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:57.391034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:57.391587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:57.392110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:57.439852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:57.441245 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:57.443374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:57.450075 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:57.450888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:57.451324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:57.452796 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:57.453405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:57.453831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:57.829245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:57.841361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:57.846714 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:57.849109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90b7fda0-29d6-4202-8cd6-561b6374c7fe tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.476474 Sep 22 12:34:57.851268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 369/753] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:57 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:57.857657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:57.864856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:34:57.873413 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-601d0e46-bafe-4b47-b36f-017464ca6ac3 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.438033 Sep 22 12:34:57.874849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 385/754] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:57 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:58.091830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b5457e-796c-4b69-9edd-b2b23758d503", "name": "network-vif-plugged", "status": "completed", "tag": "ec8f30d7-2581-41aa-a517-0d4941004617"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:58.103275 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.103834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.104287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.116396 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] Creating event network-vif-plugged:ec8f30d7-2581-41aa-a517-0d4941004617 for instance 83b5457e-796c-4b69-9edd-b2b23758d503 on hv-cinder-85646 Sep 22 12:34:58.122538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-405a8760-d2e9-41e7-8a39-8f48def900a0 req-a1cf0726-795b-4814-8e89-b5953417e548 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209465 Sep 22 12:34:58.123129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 370/755] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:58.153336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:58.155551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:58.163859 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.164311 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.164921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.167362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.168484 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.169151 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.511258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:58.520499 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d3d413c6-692e-4b0d-be92-22cf1c3c2e84 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1613 microversion: 2.1 time: 0.371983 Sep 22 12:34:58.521411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 386/756] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:58 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1613 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:34:58.733329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71cc8e1d-1561-4c72-a891-28be6d887da5", "name": "network-vif-deleted", "tag": "9c84ffaa-e05f-4013-bb0a-aa84ec774557"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:34:58.747807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.748922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.750090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.766926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] Creating event network-vif-deleted:9c84ffaa-e05f-4013-bb0a-aa84ec774557 for instance 71cc8e1d-1561-4c72-a891-28be6d887da5 on hv-cinder-85646 Sep 22 12:34:58.772417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-0ae94738-8e75-4ef4-9931-cb6a6977f92a req-677140a1-edf1-44b7-bf9e-d95459390c7d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046375 Sep 22 12:34:58.774881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 371/757] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:34:58.887107 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:58.888386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:58.898659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:58.899630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:58.901105 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.902489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.904773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.905624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.906157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.907131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.907284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.907913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.908630 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:58.909488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:58.910101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:58.910697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:59.145916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:59.146262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:59.161992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:59.163082 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-abed68c8-cc3b-464b-922a-14d714f7b87d tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1362 microversion: 2.1 time: 0.268851 Sep 22 12:34:59.164190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 372/758] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:58 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:34:59.166049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:59.167163 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7824ac10-44a6-49fd-a22d-9abe899cb1bb tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.286155 Sep 22 12:34:59.167855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 387/759] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:34:58 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:34:59.544271 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:34:59.544919 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:34:59.551394 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:59.551869 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:59.552318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:59.553006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:59.553451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:59.553874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:59.586209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:34:59.586747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:34:59.587189 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:34:59.587644 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid 71cc8e1d-1561-4c72-a891-28be6d887da5 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:34:59.635437 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:34:59.645059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dfeb4ad5-7174-4743-8e88-1f2802a86e27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 200 len: 1331 microversion: 2.1 time: 0.104612 Sep 22 12:34:59.645865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 373/760] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:34:59 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:00.137481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "name": "network-vif-plugged", "status": "completed", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:00.148772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.149247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.149679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.161790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] Creating event network-vif-plugged:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:35:00.166746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-11096b78-aa81-4511-8006-bfa8a30ca76e req-5ed65e23-0581-411b-91b9-c6904e87638d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 Sep 22 12:35:00.167552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 388/761] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:00.186990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:00.187870 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:00.195126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.195611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.195732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:00.196039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.196321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:00.196794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.197247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.197666 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.204421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.205302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.205840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.206652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.207216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.208169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.218157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:00.459169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:00.463221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:00.470766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb584650-fd78-4e6a-b06f-787ef7cca6e6 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1549 microversion: 2.1 time: 0.287138 Sep 22 12:35:00.475296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:00.477378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:00.479575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2ac7d872-77d9-4673-9313-61336f26c482 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.288785 Sep 22 12:35:00.480230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 389/762] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:00 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:00.485921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 374/763] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:00 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1549 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:00.497229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:00.498038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:00.504197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.504769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.505204 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.506064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.506519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.506939 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.588425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0ef9230d-c29a-4171-bac7-42587e7304f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094826 Sep 22 12:35:00.589041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 390/764] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:35:00 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:00.669774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:00.670417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:00.678013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.678785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.679236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.679945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:00.680446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:00.680876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:00.706928 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 HTTP/1.1 Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:35:00.709344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:35:00.711009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '71cc8e1d-1561-4c72-a891-28be6d887da5'} Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:35:00.711956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:35:00.713511 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:35:00.714956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:35:00.714956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d53eeae7-0d8a-479c-83b5-7ab01f452778 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 404 len: 111 microversion: 2.1 time: 0.049581 Sep 22 12:35:00.714956 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 375/765] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:00 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:35:00.724229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-12ea9375-94a3-4627-90b7-ffa888a6d1a1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '.version_select at 0x7f1079a9c4c0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:00.744984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-12ea9375-94a3-4627-90b7-ffa888a6d1a1 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-377352460" status: 202 len: 0 microversion: 2.1 time: 0.025182 Sep 22 12:35:00.745660 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 391/766] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 22 12:35:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-377352460 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:35:01.369050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-77ed6e98-4072-4d01-af97-b210b1f9daec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: .version_select at 0x7f1079a7faf0>, body: {"keypair": {"name": "tempest-keypair-1109809128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwPB+vm+B60KPeIuRTeuPicAQfwWfsJfVKTTfF0/NiuOZyfbkJJzpV0x9hl1qV2RNKjAhzPFKkrK0d3BZqjsqlH77lnYzuDcz/vXbp17VEuZXnAH+plfbJUv6ii71ljng=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:01.384857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-77ed6e98-4072-4d01-af97-b210b1f9daec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:35:01.388805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-77ed6e98-4072-4d01-af97-b210b1f9daec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:35:01.411196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-77ed6e98-4072-4d01-af97-b210b1f9daec tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046045 Sep 22 12:35:01.412980 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 376/767] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:35:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:01.507888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:01.510580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:01.525341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:01.525885 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:01.526703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:01.528640 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:01.530868 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:01.531479 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:01.535895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b5457e-796c-4b69-9edd-b2b23758d503", "tag": "ec8f30d7-2581-41aa-a517-0d4941004617"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:01.551321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:01.551974 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:01.552403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:01.566228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] Creating event network-changed:ec8f30d7-2581-41aa-a517-0d4941004617 for instance 83b5457e-796c-4b69-9edd-b2b23758d503 on hv-cinder-85646 Sep 22 12:35:01.571461 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9fefdbe6-91cb-4ac1-908b-80e8198e6c57 req-ef07783d-0eab-4427-a2bb-d0fabba030b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039345 Sep 22 12:35:01.572545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 377/768] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:01.707118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:01.725601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:01.727315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:01.728952 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bb261168-805c-4c54-a093-c90082327a05 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1408 microversion: 2.20 time: 0.225626 Sep 22 12:35:01.730514 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 392/769] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:01 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:35:02.767644 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:02.772147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:02.779479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:02.780783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:02.781208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:02.782158 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:02.782671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:02.783160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:02.935337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:02.936680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-486398233", "imageRef": "aadc2746-5ff8-4371-b4ca-326c309f5f37", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd"}], "security_groups": [{"name": "tempest-securitygroup--917957133"}], "key_name": "tempest-keypair-1109809128", "user_data": "}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:02.944109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:02.945890 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:02.947205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-57e5fd4c-096e-42f5-83a7-b4e57eecf770 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1600 microversion: 2.20 time: 0.195941 Sep 22 12:35:02.948673 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 378/770] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:02 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1600 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:02.973432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:02.973929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:02.980208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:02.980722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:02.981157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:02.981894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:02.982522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:02.983010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:03.087012 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b7b3dd55-9fd4-4d80-9cc1-5c712fc02cdd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117340 Sep 22 12:35:03.087593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 379/771] 10.222.0.33 () {60 vars in 1316 bytes} [Thu Sep 22 12:35:02 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 22 12:35:03.089979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] validate_networks() for [('a73a6f89-6b5d-4e1c-b8fb-c3ad31b193bd', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:35:03.504125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:35:03.504858 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:35:03.505759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:35:03.506375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:35:03.506887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:35:03.517016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:03.517557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:03.517993 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:03.518711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:03.519157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:03.519572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:03.537544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:35:03.541919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Getting quotas for user 55a7f7ba0b27479f8d1e68d808637d55 and project 40ddbbe59b90403fb3ea9212d10727aa. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:35:03.555574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:35:03.558159 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aadc2746-5ff8-4371-b4ca-326c309f5f37',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:35:03.608227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-da4da015-700e-4ace-a971-ac26574e1f1d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676147 Sep 22 12:35:03.609351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 393/772] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:35:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:35:03.620776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2214f0b7-41d2-4965-832a-05aef0696d8f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:03.621783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2214f0b7-41d2-4965-832a-05aef0696d8f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:03.684145 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2214f0b7-41d2-4965-832a-05aef0696d8f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:03.692369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2214f0b7-41d2-4965-832a-05aef0696d8f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1241 microversion: 2.1 time: 0.075978 Sep 22 12:35:03.693518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 380/773] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:03 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:04.349044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:04.363790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:04.364317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:04.364842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:04.377465 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] Creating event network-changed:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:35:04.383051 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-0ee3e966-c112-4a5d-97c7-3d39b8be49fd req-a432fb84-9849-4d86-a681-1cb9bfc2ec2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267038 Sep 22 12:35:04.384441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 394/774] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:04.715864 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:04.717734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:04.725028 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:04.725857 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:04.726802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:04.728073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:04.728964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:04.729874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:04.828806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:04.838939 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9613299e-fea9-4a17-8697-e42e5a66701e tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1293 microversion: 2.1 time: 0.126881 Sep 22 12:35:04.840748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 381/775] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:04 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1293 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:05.869845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:05.871481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:05.882014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:05.882854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:05.883421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:05.884463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:05.884982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:05.885639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:06.115822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:06.125816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-057480dc-3b98-4a77-8e14-0e8eb7164b27 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.262996 Sep 22 12:35:06.132374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 395/776] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:05 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:06.649908 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b913950e-49dc-4312-a031-e540dfc3a13a", "tag": "85b52988-87be-42ca-a43c-2728eb267c3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:06.661319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:06.662119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:06.662740 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:06.674397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] Creating event network-changed:85b52988-87be-42ca-a43c-2728eb267c3a for instance b913950e-49dc-4312-a031-e540dfc3a13a on hv-cinder-85646 Sep 22 12:35:06.680461 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b71308f3-5425-4335-bde3-3934d2a1de1b req-3858a410-6e73-457f-ab8e-c1ea8bb57750 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034192 Sep 22 12:35:06.681581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 382/777] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:07.149785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:07.150504 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:07.157371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:07.158017 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:07.158538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:07.159443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:07.160096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:07.160649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:07.298411 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:07.306309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d66ecb87-c847-41dd-8065-7d952fee9766 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.160633 Sep 22 12:35:07.307197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 396/778] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:07 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:08.333108 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:08.333943 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:08.340431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:08.341137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:08.342238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:08.343166 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:08.343741 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:08.344168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:08.478729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:08.486814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-23b9073e-495d-4567-b5c6-4127bfdefc1f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.159428 Sep 22 12:35:08.487363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 383/779] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:08 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:09.509306 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:09.509922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:09.516962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:09.517445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:09.517887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:09.518575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:09.519028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:09.519454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:09.652877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:09.660572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5cc5fdf7-5f7b-4902-b6c3-08e12a8aca6a tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.155017 Sep 22 12:35:09.661154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 397/780] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:09 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:10.682889 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:10.683475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:10.689900 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:10.690374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:10.690802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:10.691528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:10.691971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:10.692415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:10.821828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:10.829967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-65606d6a-e0d3-4409-a403-46781d45b322 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.150959 Sep 22 12:35:10.830524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 384/781] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:10 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:11.795510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b913950e-49dc-4312-a031-e540dfc3a13a", "name": "network-vif-plugged", "status": "completed", "tag": "85b52988-87be-42ca-a43c-2728eb267c3a"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:11.806141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:11.806620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:11.807048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:11.818369 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] Creating event network-vif-plugged:85b52988-87be-42ca-a43c-2728eb267c3a for instance b913950e-49dc-4312-a031-e540dfc3a13a on hv-cinder-85646 Sep 22 12:35:11.823189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-e806061c-54c7-401d-86ea-6e5e809ab4ff req-507d8506-594b-45d9-91b1-3dd283777722 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Sep 22 12:35:11.823820 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 398/782] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:11.852382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:11.853451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:11.860803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:11.861410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:11.861903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:11.862610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:11.863056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:11.863475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:12.034325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:12.042508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e674d1c6-97b2-4d66-a727-75bd98c489ef tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.194012 Sep 22 12:35:12.043174 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 385/783] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:11 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:35:13.066737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:13.067473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:13.073756 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:13.074249 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:13.074872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:13.075579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:13.076038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:13.076564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:13.215231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:13.223636 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b35df326-f8ab-4a63-85ef-31b702ad09c8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1366 microversion: 2.1 time: 0.161924 Sep 22 12:35:13.224208 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 399/784] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:13 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:14.247179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:14.247792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:14.251032 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:14.256269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:14.256795 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:14.257234 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:14.257940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:14.258399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:14.258828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:14.387211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:14.395670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-82a0bb79-79bd-42fd-97f7-c8a37c054e79 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1556 microversion: 2.1 time: 0.152324 Sep 22 12:35:14.396320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 386/785] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:14 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:14.417717 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:14.418245 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:14.420108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:14.421452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:14.428563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:14.429047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:14.429481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:14.430176 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:14.430627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:14.431049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:14.512752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5c931f3-e5b3-4b79-873c-9c10460a5d0b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098774 Sep 22 12:35:14.513336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 400/786] 10.222.0.33 () {58 vars in 1275 bytes} [Thu Sep 22 12:35:14 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:15.716623 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b913950e-49dc-4312-a031-e540dfc3a13a", "tag": "85b52988-87be-42ca-a43c-2728eb267c3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:15.729572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:15.730070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:15.730529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:15.742670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] Creating event network-changed:85b52988-87be-42ca-a43c-2728eb267c3a for instance b913950e-49dc-4312-a031-e540dfc3a13a on hv-cinder-85646 Sep 22 12:35:15.748516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-6da097ce-7156-48ca-9ffd-014834f83296 req-68cf842b-400e-4c37-87a5-e32bf121e39e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035849 Sep 22 12:35:15.749184 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 387/787] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:37.974161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:37.975347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:37.978427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:37.979474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=64 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:37.984883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:37.985585 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:37.986203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:37.987276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:37.988166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:37.988818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:38.017076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-be9864a0-6f6f-45d7-af7c-ffb54f2b8505 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/ips" status: 200 len: 146 microversion: 2.1 time: 0.047267 Sep 22 12:35:38.017652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 401/788] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:35:37 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:38.528095 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:38.528881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=50 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:38.694203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73e9be2f-b1ab-496f-be8d-658b8b78cc3c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Action: 'create', calling method: .version_select at 0x7f1079a6f0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1194840390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDS4iganjfN7ZrCVExnqNaT6X/VxQ9Y+JU85DLtfx57eBKSEMycSfynGa3S9BgjaVeW11PsT26aG39M3O2uMRaKAnAMiinUF2gnSZq673TvGDI6MamA+YRqUrGThV6y8wA=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:38.710331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-73e9be2f-b1ab-496f-be8d-658b8b78cc3c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:35:38.714366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-73e9be2f-b1ab-496f-be8d-658b8b78cc3c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for user f42af00458ac4046888a73397218f9f5 and project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:35:38.737727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73e9be2f-b1ab-496f-be8d-658b8b78cc3c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.215420 Sep 22 12:35:38.738336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 388/789] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:35:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:39.489273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3716b4b3-bf8a-47c0-8f82-6b588cb6dae0"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:39.493971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:39.522175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:39.525081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:39.525529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:39.527310 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:39.527943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:39.528577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:39.844851 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f7cb52fb-4dcd-4d3d-99f8-83a66a0af8c7 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359583 Sep 22 12:35:39.848713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 402/790] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:35:39 2022] POST /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:40.416408 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:40.417194 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:40.425482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:40.426336 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:40.426778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:40.427611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:40.428070 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:40.428546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:40.454937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-42eca435-86c9-4a37-a6df-cb98adb4c730 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/ips" status: 200 len: 152 microversion: 2.20 time: 0.199767 Sep 22 12:35:40.455496 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 389/791] 10.222.0.33 () {60 vars in 1289 bytes} [Thu Sep 22 12:35:40 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/ips => generated 152 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:35:42.473521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:42.474145 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:42.481699 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:42.482196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:42.482736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:42.483637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:42.484263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:42.484941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:42.516506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lazy-loading 'flavor' on Instance uuid 5bb3c468-640c-42bf-8f8d-d93c01948176 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:35:42.730076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-17e58631-23e9-4d8d-a3c4-e0214fa121a6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/action" status: 202 len: 0 microversion: 2.20 time: 0.262313 Sep 22 12:35:42.730803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 403/792] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 22 12:35:42 2022] POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:35:42.740180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:42.740823 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:42.747621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:42.748099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:42.748910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:42.750011 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:42.751308 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:42.751769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:42.903549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:42.912470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:42.913946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:42.915113 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d7f9f4e6-1808-4707-8719-5b019996cdae tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.179270 Sep 22 12:35:42.915863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 390/793] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:42 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:43.942539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:43.943242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:43.950265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:43.950747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:43.951182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:43.951864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:43.952332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:43.952764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:44.083926 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:44.092112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:44.093661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:44.095024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6cd04436-6598-41e7-bc08-674d2bd4f10d tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.157597 Sep 22 12:35:44.095712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 404/794] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:43 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:45.122257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:45.122858 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:45.129498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:45.129919 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:45.130352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:45.131029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:45.131475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:45.131898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:45.271478 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:45.279605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:45.281086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:45.282258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-73ff7456-5856-4c1b-bc07-6ba06ae7ec67 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.163947 Sep 22 12:35:45.282845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 391/795] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:45 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:46.307339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:46.307968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:46.314646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.315168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.315604 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.316307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.316775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.317201 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.363707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:46.366079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:46.372393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.372877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.373307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.374029 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.374476 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.374896 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.406556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-553174c7-32e3-44a5-ad7b-312661acc806 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Sep 22 12:35:46.407340 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 392/796] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:35:46 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:46.418139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:46.418637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:46.424504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.424931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.425366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.426054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:46.426504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:46.426925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:46.455037 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:46.456451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36ce8b56-1ff9-4752-9175-41677dfc0a21 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0" status: 200 len: 194 microversion: 2.1 time: 0.041980 Sep 22 12:35:46.457055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 393/797] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 22 12:35:46 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:46.463934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:46.465280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:46.466430 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-78091da0-fa47-4967-96a6-c20dd43130af tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.162937 Sep 22 12:35:46.466975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 405/798] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:46 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:47.493269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:47.493887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:47.500239 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:47.500756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:47.501195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:47.501917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:47.502885 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:47.503315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:47.634793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:47.645482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:47.647057 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:47.648207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-37b22a9c-e6cc-4bae-9089-5e2cf03969f0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.158879 Sep 22 12:35:47.648785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 394/799] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:47 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:47.801437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "776a4e1a-8f38-47ba-ab14-a7fd0024303b"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:47.803909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:47.810417 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:47.810906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:47.811347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:47.812058 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:47.812549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:47.812975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:48.070519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fc56a84a-4ae3-4289-9584-54865b8298f2 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "POST /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273297 Sep 22 12:35:48.071272 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 406/800] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:35:47 2022] POST /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:48.672980 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:48.673581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:48.680268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:48.680783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:48.681212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:48.681907 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:48.682352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:48.682805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:48.721047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:48.818710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:48.828871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:48.830344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:48.832010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6097b5f-4284-4ceb-a68c-be4415393949 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.162875 Sep 22 12:35:48.832585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 395/801] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:48 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:49.862877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:49.862877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:49.866501 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:49.866981 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:49.867418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:49.868120 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:49.868597 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:49.869019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:50.001701 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:50.011694 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:50.013146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:50.014307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-52773311-089c-4dff-8422-211992197ac6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.159660 Sep 22 12:35:50.014854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 407/802] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:49 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:51.039428 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:51.040066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:51.046522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:51.047006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:51.047441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:51.048128 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:51.048612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:51.049037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:51.175288 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:51.183442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:51.184924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:51.186074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b6f7e3b0-640c-4b46-9767-19a673eadec0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.150472 Sep 22 12:35:51.186628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 396/803] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:51 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:52.211752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:52.212424 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:52.218777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:52.219254 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:52.219682 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:52.220399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:52.220844 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:52.221773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:52.351799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:52.360423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:52.361855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:52.363012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7b0b3c57-fb8e-4fe6-a1b6-c03a3e52c999 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.155308 Sep 22 12:35:52.363558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 408/804] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:52 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:53.386953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:53.387587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:53.394155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:53.394636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:53.395066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:53.395751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:53.396205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:53.396649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:53.523683 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:53.531733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:53.533175 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:53.534314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-792b6aa1-d697-484e-8f5c-739f49b5c795 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.151377 Sep 22 12:35:53.534852 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 397/805] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:53 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:54.559842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:54.560472 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:54.567328 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:54.567849 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:54.568314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:54.569028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:54.569722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:54.570155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:54.699909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:54.708596 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:54.710079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:54.711228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c36e7137-3ee0-4941-a5f4-8fdc5ce26843 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.155238 Sep 22 12:35:54.711783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 409/806] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:54 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:55.257390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1891927186", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194840390", "security_groups": [{"name": "tempest-secgroup-smoke-358311579"}], "block_device_mapping_v2": [{"uuid": "79063296-0c17-45c4-b567-158a25bdadd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1ec96ed-6bf3-486f-b981-c8837f8cbc07"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:55.371151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] validate_networks() for [('a1ec96ed-6bf3-486f-b981-c8837f8cbc07', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:35:55.603866 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:55.606202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:55.612966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.613454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.613883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.614563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.615008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.615425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.647906 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3bfd7795-3520-406c-97d6-3f901d62e416 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048230 Sep 22 12:35:55.648495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 410/807] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:35:55 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:35:55.737286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:35:55.737789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:35:55.738345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:35:55.738829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:35:55.739346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:35:55.739720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:55.740357 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:55.746267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.746752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.747185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.747878 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.748420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.748545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.748853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.749023 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.749465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.750202 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.750660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.751095 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.768047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:35:55.772069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for user f42af00458ac4046888a73397218f9f5 and project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:35:55.829076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:35:55.831206 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79063296-0c17-45c4-b567-158a25bdadd0',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:35:55.879110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:55.891401 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:55.892949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:55.894131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-2b7cd997-8460-4a5e-a0df-749e0b8b8101 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.158950 Sep 22 12:35:55.894722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 411/808] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:55 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:35:55.899580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:55.900079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:55.905999 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.906482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.906922 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.907848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.908315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.909464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.941135 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4be2c02e-59ca-4a80-847b-2bc5bde7091e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0" status: 200 len: 194 microversion: 2.1 time: 0.045262 Sep 22 12:35:55.941813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 412/809] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 22 12:35:55 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:55.952596 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:55.953340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:55.959531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.959781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.960231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.961013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:55.961462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:55.961928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:55.966771 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:35:55.978746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aba1156c-834b-4dde-8284-85946a18b1d3 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.725095 Sep 22 12:35:55.979703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 398/810] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:35:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:35:55.991350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-67c2443d-7e06-4928-aa86-381582fdb137 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:55.991898 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-67c2443d-7e06-4928-aa86-381582fdb137 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:56.050013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-67c2443d-7e06-4928-aa86-381582fdb137 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:56.058524 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-67c2443d-7e06-4928-aa86-381582fdb137 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1095 microversion: 2.1 time: 0.071597 Sep 22 12:35:56.066175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lazy-loading 'services' on Instance uuid 83b5457e-796c-4b69-9edd-b2b23758d503 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:35:56.074334 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 399/811] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:55 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:35:56.139151 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ec8c8b46-4f2b-4342-b621-fa5607383354 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0" status: 202 len: 0 microversion: 2.1 time: 0.190097 Sep 22 12:35:56.140154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 413/812] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:35:55 2022] DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/3716b4b3-bf8a-47c0-8f82-6b588cb6dae0 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 12:35:56.921105 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:56.921692 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:56.928591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:56.929068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:56.929500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:56.930181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:56.930626 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:56.931047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.070994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:57.081316 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:57.082786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:57.083804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:57.084243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a83cd4ee-e9d1-4177-9a07-3bb544d14a42 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.166705 Sep 22 12:35:57.084492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 400/813] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:56 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:57.085296 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:57.092063 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.092918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.093565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.094269 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.094725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.095151 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.164891 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:57.172577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dc50c858-c483-45be-9658-fb8bd894ab7c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1193 microversion: 2.1 time: 0.094857 Sep 22 12:35:57.173136 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 414/814] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:57 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:35:57.264868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:57.265368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:57.272042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.272578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.273019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.273716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.274175 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.274605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.303137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f1195ec6-16f3-4dff-8843-48edd811bdb4 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/776a4e1a-8f38-47ba-ab14-a7fd0024303b" status: 200 len: 194 microversion: 2.1 time: 0.042166 Sep 22 12:35:57.303710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 401/815] 10.222.0.33 () {58 vars in 1413 bytes} [Thu Sep 22 12:35:57 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/776a4e1a-8f38-47ba-ab14-a7fd0024303b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:57.314114 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:57.315160 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:57.321092 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.321571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.322004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.322688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:57.323140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:57.323562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:57.402807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lazy-loading 'services' on Instance uuid 83b5457e-796c-4b69-9edd-b2b23758d503 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:35:57.472765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ee66162c-c15c-4d66-bb83-4a77f728ae60 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/776a4e1a-8f38-47ba-ab14-a7fd0024303b" status: 202 len: 0 microversion: 2.1 time: 0.162383 Sep 22 12:35:57.473347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 415/816] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:35:57 2022] DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments/776a4e1a-8f38-47ba-ab14-a7fd0024303b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:35:58.110543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:58.111151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:58.118085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.118565 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.118996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.119696 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.120137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.120579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.198077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:58.202540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:58.210243 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.210840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.211349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.212123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.212679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.213229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.558670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:58.567086 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c09952c6-bb81-4427-879b-8f84af2fb43f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1211 microversion: 2.1 time: 0.375635 Sep 22 12:35:58.567933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 416/817] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:58 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1211 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:58.577551 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:58.587996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:58.589977 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:58.591346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7cb2a368-a19c-40a4-91a1-aebe58c51973 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.484583 Sep 22 12:35:58.592153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 402/818] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:58 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:35:58.681055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:58.683451 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:58.691321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.691910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.692568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.693414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.694085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.694838 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.728280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-eecd5c2e-1161-4db4-8f64-4d86ab6f2247 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050760 Sep 22 12:35:58.729124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 417/819] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:35:58 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:35:58.887306 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:58.893653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:58.900825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.901368 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.901807 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.902518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:58.902990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:58.903404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:58.934096 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f8bf939b-9e9c-49ae-b1a4-b619bf6ea6d8 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052124 Sep 22 12:35:58.934703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 403/820] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:35:58 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:35:59.003288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:59.003786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:59.009913 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.010407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.010841 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.011533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.012175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.012617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.041140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:35:59.136074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4e0d8f53-dee2-4410-ba5f-d6eb3a9da154 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 204 len: 0 microversion: 2.1 time: 0.136780 Sep 22 12:35:59.136875 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 418/821] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:35:58 2022] DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:35:59.145314 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:59.146473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:59.153079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.153506 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.153941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.154667 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.155121 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.155683 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.376017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:59.384955 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-0890c9af-9878-4e12-9527-0e3da54bb8bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1673 microversion: 2.1 time: 0.243753 Sep 22 12:35:59.385532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 404/822] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:59 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1673 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:59.553972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:59.554568 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:59.561011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.561683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.562129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.562830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.563285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.563709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.587131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c938cecc-a589-48ef-b971-aaba041981f2 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/ips" status: 200 len: 149 microversion: 2.1 time: 0.038019 Sep 22 12:35:59.587700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 419/823] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:35:59 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:35:59.593269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:59.594299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:59.605782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.606523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.606990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.609912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.610600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.611046 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.623624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:35:59.623878 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:35:59.640625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.641273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.641709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.642536 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.643317 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.643785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.921984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:59.934262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:59.935492 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:59.937004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:35:59.939205 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d5786ab4-4155-4556-b781-ad1854734a30 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.320076 Sep 22 12:35:59.946051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-719d3e49-a1e1-42d0-8f5c-e5b2407b64c1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.356216 Sep 22 12:35:59.947534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 405/824] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:35:59 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:35:59.953638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 420/825] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:35:59 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:35:59.957149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca03754-f373-43f1-b251-20165efd6733", "tag": "48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:35:59.968958 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:35:59.969419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:35:59.970056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:35:59.983404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] Creating event network-changed:48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f for instance cca03754-f373-43f1-b251-20165efd6733 on hv-cinder-85646 Sep 22 12:35:59.988632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e7286a43-dc6c-4142-b13d-b71e07d11b9b req-d07f7484-bcde-473f-a522-9ce02235935b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038242 Sep 22 12:35:59.989364 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 406/826] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:00.406930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:00.407537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:00.413718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.414202 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.414634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:00.415321 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.415771 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.416196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:00.542033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:00.551946 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c68de447-ce51-4416-8c85-7fc599c7f1a1 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1673 microversion: 2.1 time: 0.148844 Sep 22 12:36:00.553852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 421/827] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:00 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:00.972539 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:00.972539 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:00.973055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:00.973399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:00.975331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.975895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.976430 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:00.977195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.978208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.978720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:00.986303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.987623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.988205 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:00.988954 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:00.989410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:00.989837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:01.323792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:01.332409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:01.333983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:01.335009 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f83dd13e-fbc8-4543-92ba-87f1d1c57ce6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.372669 Sep 22 12:36:01.335643 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 407/828] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:00 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:01.340229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "598272a0-5041-4333-96f5-234fa6f9f266"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:01.342829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:01.349273 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:01.349752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:01.350185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:01.350878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:01.351326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:01.351745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:01.355856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:01.359308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:01.367441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-41e855e1-f924-4372-9061-0dc026404167 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.398872 Sep 22 12:36:01.368074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 422/829] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:00 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:36:01.579815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:01.581221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:01.587559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:01.588049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:01.588532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:01.589241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:01.589923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:01.590352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:01.606838 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-229bbb5e-a56c-4081-8773-84b675dc18fe tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "POST /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269836 Sep 22 12:36:01.607874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 408/830] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:36:01 2022] POST /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:01.936882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:01.945233 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b4f6590d-4946-431c-bb67-c502205a9c6f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1673 microversion: 2.1 time: 0.369970 Sep 22 12:36:01.945797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 423/831] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:01 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1673 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:36:02.363112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:02.363855 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:02.370525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.371012 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.371452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.372155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.372637 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.373068 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.390077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:02.390683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:02.397890 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.398386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.398807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.399519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.399974 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.400436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.878172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:02.879372 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:02.887578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-33fea5fa-b568-45d7-a138-f6f24a665c5b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.501299 Sep 22 12:36:02.887804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:02.888593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 424/832] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:02 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:36:02.889209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:02.890381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-da3feb41-8453-42a2-8507-a82063e4a5f1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.532353 Sep 22 12:36:02.891414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 409/833] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:02 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:02.894812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b5457e-796c-4b69-9edd-b2b23758d503", "name": "network-vif-deleted", "tag": "ec8f30d7-2581-41aa-a517-0d4941004617"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:02.904979 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.905633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.906113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.922975 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] Creating event network-vif-deleted:ec8f30d7-2581-41aa-a517-0d4941004617 for instance 83b5457e-796c-4b69-9edd-b2b23758d503 on hv-cinder-85646 Sep 22 12:36:02.927816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-0ba33c8f-f726-4ae9-9274-87c42e19a9d1 req-7e4883a7-69e8-4c6e-8f08-88960f704ab9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037809 Sep 22 12:36:02.928445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 425/834] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:02.969740 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:02.970811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:02.977448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.978424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.979090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:02.979806 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:02.980483 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:02.981040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:03.056581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49c772b0c2bb49a4ab4048d980bd20a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89fe74d1d646452e83cb93420766c0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:03.064944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cbed649f-5bcc-4b3d-aa41-3f519fc9a013 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 200 len: 1322 microversion: 2.1 time: 0.099041 Sep 22 12:36:03.065431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 410/835] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:02 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:03.924780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:03.925920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:03.926348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:03.926615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:03.932529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:03.932886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:03.933014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:03.933356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:03.933496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:03.933781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:03.934117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:03.934464 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:03.934573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:03.934906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:03.935026 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:03.935325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:04.136214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:04.139975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:04.144011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a82fed0c-47b7-44eb-84e1-0de100353cab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.224689 Sep 22 12:36:04.144625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 426/836] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:03 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:04.148400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:04.148948 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:04.149540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:04.149836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:04.151280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43d047d0-cf8b-4a7a-b9fd-92608030541a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1746 microversion: 2.20 time: 0.230060 Sep 22 12:36:04.155004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:04.155482 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:04.155919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:04.156651 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:04.157096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:04.157510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:04.162073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 411/837] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:03 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:04.171308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 HTTP/1.1 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:04.172963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:04.175166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '83b5457e-796c-4b69-9edd-b2b23758d503'} Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:04.176265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:04.177911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:04.179613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:04.179613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4adb7387-76c2-4f91-be3d-8c043ad2a374 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 404 len: 111 microversion: 2.1 time: 0.029429 Sep 22 12:36:04.179613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 427/838] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:04 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:04.183465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-12cfb735-173c-4fc7-9a98-50c34590e93e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '.version_select at 0x7f107d4a09d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:04.202235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-12cfb735-173c-4fc7-9a98-50c34590e93e tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893766943" status: 202 len: 0 microversion: 2.1 time: 0.022380 Sep 22 12:36:04.202797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 412/839] 10.222.0.33 () {58 vars in 1218 bytes} [Thu Sep 22 12:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893766943 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:36:05.168684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:05.169283 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:05.177542 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:05.178019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:05.178380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:05.178794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:05.179110 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:05.179214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:05.179563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:05.179980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:05.186815 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:05.187585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:05.188219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:05.189154 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:05.190367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:05.190981 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:05.204740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:05.400999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:05.405529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:05.409950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:05.411379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:05.412622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cceefdc0-0125-4b15-8795-6a50bb3db983 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1746 microversion: 2.20 time: 0.238918 Sep 22 12:36:05.413298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 413/840] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:05 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1746 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:05.413726 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ee9618d7-9905-4c49-abf2-3a865737e66b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.249478 Sep 22 12:36:05.414339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 428/841] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:05 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:06.438869 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:06.440065 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:06.440453 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:06.441074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:06.446368 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:06.446546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:06.446790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:06.447396 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:06.447799 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=8 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:06.448267 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:06.448951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:06.449569 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:06.450641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:06.451139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:06.451595 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:06.452550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:06.453180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:06.454165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:06.675038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:06.679257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:06.693710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-597506ea-684a-448f-b512-5ce4dc640eb1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.258605 Sep 22 12:36:06.695155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:06.696694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:06.697439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 429/842] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:06 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:06.698789 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-21bcb134-b5fb-4161-afaa-f70c30b98728 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.265382 Sep 22 12:36:06.712890 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 414/843] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:06 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:07.120024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:07.120711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:07.127714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.128206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.128669 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.129374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.129830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.130257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.145312 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 HTTP/1.1 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:07.146877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.148512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '83b5457e-796c-4b69-9edd-b2b23758d503'} Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:07.149351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.151166 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.153519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:07.153519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1c12f157-b1c6-4180-81db-e1c379ebf3bb tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 404 len: 111 microversion: 2.1 time: 0.032219 Sep 22 12:36:07.153519 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 430/844] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:07 2022] DELETE /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:07.156914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:07.157703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 83b5457e-796c-4b69-9edd-b2b23758d503] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:07.164191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.165026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.165659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.166559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.167327 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.167958 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.182824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 HTTP/1.1 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:07.184572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.185991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '83b5457e-796c-4b69-9edd-b2b23758d503'} Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:07.186750 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. Sep 22 12:36:07.188010 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:07.189139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 83b5457e-796c-4b69-9edd-b2b23758d503 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:07.189139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85cd5b11-0eb4-41b8-97f9-bb32ccceb450 tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503" status: 404 len: 111 microversion: 2.1 time: 0.032823 Sep 22 12:36:07.190648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 415/845] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:07 2022] GET /compute/v2.1/servers/83b5457e-796c-4b69-9edd-b2b23758d503 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:07.726059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:07.727097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:07.728168 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:07.731909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:07.735312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.735887 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.737023 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.737814 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.738367 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.739008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.740539 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.741027 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.741459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.742154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:07.742603 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:07.743197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:07.959977 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:07.960853 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:07.969105 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1f89bbb7-2409-4c7a-9833-6c20933bdcc9 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.252149 Sep 22 12:36:07.971204 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 431/846] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:07 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:07.972174 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:07.974353 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:07.975774 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1332039b-7de3-4490-893e-1997cca7753f tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.253568 Sep 22 12:36:07.976330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 416/847] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:07 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:08.130307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "name": "network-vif-plugged", "status": "completed", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:08.140553 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:08.141429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:08.146811 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:08.160957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] Creating event network-vif-plugged:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:36:08.166349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-f0f17d0b-52d9-48c6-bca8-e30a90d89360 req-2b5d3735-c017-4ae6-80d3-4224fd2005ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Sep 22 12:36:08.170832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 432/848] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:08.347467 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:08.348150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:08.354698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:08.355299 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:08.355816 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:08.356539 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:08.357171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:08.357592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:08.373020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 HTTP/1.1 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:08.374830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.376190 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '05ee64bd-305d-44e5-a1b7-00f4ef55cf64'} Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:08.376985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.378957 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.380634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:08.380634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-910ed43f-c4c1-49ff-a392-7f8333df3c3f tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 404 len: 111 microversion: 2.1 time: 0.033237 Sep 22 12:36:08.380634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 417/849] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:08 2022] DELETE /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:08.390680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:08.391528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] [instance: 05ee64bd-305d-44e5-a1b7-00f4ef55cf64] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:08.400436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:08.401239 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:08.402010 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:08.402825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:08.403380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:08.403910 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:08.419513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] HTTP exception thrown: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Request method failure captured: Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 HTTP/1.1 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUiQeCqbjoosxyq7NcF6ghAEfqM-15HnbkLcJqk9a3tm1xqqePHp_RZzW0IojjeAQQqUfk0tDL10RLdRROxINdncDvzv3tiYN_tm11L9F6sD8n6449te9eqpBGzJTS2-1fzSGt6puLqTfQAaBUOZgGSTkaMm_CWkbVE0DY2mGFYJuo Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:08.421203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/89fe74d1d646452e83cb93420766c0a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_89fe74d1d646452e83cb93420766c0a2"}]}] Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 89fe74d1d646452e83cb93420766c0a2 Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeTestJSON-851336899 Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 49c772b0c2bb49a4ab4048d980bd20a8 Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeTestJSON-851336899-project Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.422863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '05ee64bd-305d-44e5-a1b7-00f4ef55cf64'} Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:08.425074 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. Sep 22 12:36:08.426513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:08.427808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] Returning 404 to user: Instance 05ee64bd-305d-44e5-a1b7-00f4ef55cf64 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:08.427808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-36fd2dde-c912-49e7-95ed-7368e37f2d3b tempest-AttachVolumeTestJSON-851336899 tempest-AttachVolumeTestJSON-851336899-project] 10.222.0.33 "GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64" status: 404 len: 111 microversion: 2.1 time: 0.040104 Sep 22 12:36:08.427808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 433/850] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:08 2022] GET /compute/v2.1/servers/05ee64bd-305d-44e5-a1b7-00f4ef55cf64 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:08.995005 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:08.995769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:09.003043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:09.003708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:09.004990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:09.005369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.006006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.006577 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.007406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.008080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.008737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.018270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.019061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.019703 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.020685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.021308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.022235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.385128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:09.394495 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:09.396064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:09.397351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5744eef1-34fe-4971-9235-70c01e7f6cc1 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.399765 Sep 22 12:36:09.420884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:09.425709 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 434/851] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:08 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:09.431436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4157a95b-8bc6-4e0f-b9b7-33fdcf891c5e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.440118 Sep 22 12:36:09.435379 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:09.435876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:09.436725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 418/852] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:08 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:09.443710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.444475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.445079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.445953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.446574 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.447186 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.557619 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'services' on Instance uuid b913950e-49dc-4312-a031-e540dfc3a13a {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:36:09.657427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3b2f8dd1-a4a7-488a-ba11-a007962924c4 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments/598272a0-5041-4333-96f5-234fa6f9f266" status: 202 len: 0 microversion: 2.1 time: 0.230086 Sep 22 12:36:09.659230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 435/853] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:36:09 2022] DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments/598272a0-5041-4333-96f5-234fa6f9f266 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:36:09.676263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:09.684837 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:09.701777 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.702432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.702979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.705594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:09.706399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:09.707214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:09.759412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d17ae80a-bebf-4bcd-bfb2-1d99d0cd6aee tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095775 Sep 22 12:36:09.764409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 419/854] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:36:09 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:10.434004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:10.436538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:10.443582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:10.445888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.446593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.447263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.448167 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.448904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.449720 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.459992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:10.461919 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:10.473064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.489074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.490018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.494803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.496846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.498013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.830139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:10.846386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:10.851963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:10.853600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ac14d17b-671e-48d5-8b4b-40c534defba5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.431013 Sep 22 12:36:10.869097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 436/855] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:10 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:10.879364 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:10.882854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:10.889273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.889918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.890366 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.891072 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:10.891817 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:10.892257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:10.907036 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:10.921233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b86e82d-f5de-40d0-ae60-99e3ae79f3af tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.465992 Sep 22 12:36:10.923263 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 420/856] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:10 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:10.930252 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a8932923-efc1-4d0a-a922-36eada3ae4c9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059927 Sep 22 12:36:10.933758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 437/857] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:36:10 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:36:11.013781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:11.014758 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:11.035783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.036204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.037008 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.037763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.038228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.038662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.066622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:36:11.184363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-885219f7-17a4-4bba-99c5-6cfac8391319 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 204 len: 0 microversion: 2.1 time: 0.174530 Sep 22 12:36:11.188361 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 421/858] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:11 2022] DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:36:11.193315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:11.194845 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:11.211572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.214261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.214714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.215445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.215902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.216352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.515394 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:11.528420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6b394131-eb87-4399-b122-98fd3ce9b06b tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1680 microversion: 2.1 time: 0.337059 Sep 22 12:36:11.529330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 438/859] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:11 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1680 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:36:11.883521 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:11.885363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:11.894237 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.895291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.895743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.897487 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.897954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.898392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.949199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:11.950006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:11.957943 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.958440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.963752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:11.964584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:11.965064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:11.965500 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:12.301489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:12.314731 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:12.326355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5d355d0e-6310-4e4a-ba09-f4a6a0e6144b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.380902 Sep 22 12:36:12.335973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 439/860] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:11 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:12.337062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:12.342262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:12.346206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca03754-f373-43f1-b251-20165efd6733", "name": "network-vif-plugged", "status": "completed", "tag": "48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:12.353836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b16e6fb8-7be3-41c3-a005-1415aacb1c04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.466450 Sep 22 12:36:12.357308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:12.358303 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:12.358934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:12.368883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 422/861] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:11 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:12.372706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] Creating event network-vif-plugged:48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f for instance cca03754-f373-43f1-b251-20165efd6733 on hv-cinder-85646 Sep 22 12:36:12.379365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-52b70762-5866-4c2f-95a3-fe955ed52d0f req-1007987d-cd85-45a2-9e78-3816fad156ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040798 Sep 22 12:36:12.380617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 440/862] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:12.559737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:12.562265 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:12.573685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:12.574269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:12.574846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:12.575593 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:12.576064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:12.576527 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:12.778754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:12.792946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cd2ad70a-1731-4912-ac85-3afee3a1c613 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1680 microversion: 2.1 time: 0.239376 Sep 22 12:36:12.793550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 423/863] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:12 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1680 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:13.362217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:13.363481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:13.385210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:13.386442 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:13.389505 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.389921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.390365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:13.391087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.391608 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.394590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:13.396969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.404967 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.405628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:13.406546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.407160 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.407751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:13.415671 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:13.867901 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:13.876276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-47e4ccd0-28a6-4bbf-8a9e-415596d7f049 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.530854 Sep 22 12:36:13.879581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 441/864] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:13 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:13.893448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:13.903430 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:13.905647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:13.907342 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:13.908705 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:13.912600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-15a5623e-9085-46b7-8905-3d63ec5b327b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.531100 Sep 22 12:36:13.914832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 424/865] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:13 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:13.919433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.920156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.920877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:13.921942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:13.922600 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:13.923228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:14.175403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:14.185399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4acecc85-4dbd-4527-b963-4dda93fd30bf tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1680 microversion: 2.1 time: 0.304601 Sep 22 12:36:14.188005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 442/866] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:13 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1680 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:14.710281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b913950e-49dc-4312-a031-e540dfc3a13a", "name": "network-vif-deleted", "tag": "85b52988-87be-42ca-a43c-2728eb267c3a"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:14.725189 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:14.725658 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:14.726081 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:14.748196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] Creating event network-vif-deleted:85b52988-87be-42ca-a43c-2728eb267c3a for instance b913950e-49dc-4312-a031-e540dfc3a13a on hv-cinder-85646 Sep 22 12:36:14.756274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-b11812a1-169b-4e90-ae4a-414460d43d74 req-91f17910-3193-4ea8-b08b-ab3ddea4a630 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053003 Sep 22 12:36:14.765713 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 425/867] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:14.901607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:14.902220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:14.917222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:14.917976 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:14.918610 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:14.919477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:14.920088 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:14.920998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:14.938500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:14.940329 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:14.963286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:14.963883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:14.964339 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:14.965031 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:14.965476 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:14.968207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:15.573513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:15.581940 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f279968c-b209-4299-8cdb-343959b86f69 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1266 microversion: 2.1 time: 0.684520 Sep 22 12:36:15.582506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 443/868] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:14 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1266 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:15.597169 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:15.597778 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:15.614052 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:15.620713 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:15.621196 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:15.622146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:15.625085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:15.626781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:15.627769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:15.629213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:15.631197 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:15.632206 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb9f7fb3-cf8a-46f4-b718-6d752541cd09 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.697830 Sep 22 12:36:15.635301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 426/869] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:14 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:15.683995 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:15.684939 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:15.685537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:15.685984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lazy-loading 'fault' on Instance uuid b913950e-49dc-4312-a031-e540dfc3a13a {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:36:15.741123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a7f7ba0b27479f8d1e68d808637d55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40ddbbe59b90403fb3ea9212d10727aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:15.749745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71f6a5f2-4980-4b7a-9cbf-97d3d04c6e5d tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 200 len: 1331 microversion: 2.1 time: 0.166230 Sep 22 12:36:15.764655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 444/870] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:15 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:16.632654 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:16.634379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:16.645533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.646639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.647088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.648103 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.649083 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.649787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.669025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:16.669698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:16.684329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.686439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.687048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.690513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.691178 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.691777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.895698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:16.906165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b337776-7f31-4e07-a54a-7ed01c36f727 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1452 microversion: 2.1 time: 0.278044 Sep 22 12:36:16.916452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 427/871] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:16 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1452 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:16.924645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:16.927153 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:16.935395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.936699 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.937386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.938833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.939872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.940563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.949177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:16.959453 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:16.961227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a HTTP/1.1 Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:16.961801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:16.963156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'b913950e-49dc-4312-a031-e540dfc3a13a'} Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:16.963995 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:16.978663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:16.979740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:16.979740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ace796e7-f719-44b8-b360-58c551acfd86 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.299792 Sep 22 12:36:16.979740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 445/872] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:16 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:16.979972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:16.979972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6dd4d2c-4141-41db-ab68-7cba3dff0d9f tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 404 len: 111 microversion: 2.1 time: 0.047287 Sep 22 12:36:16.979972 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 428/873] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:16 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:16.980191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:16.980191 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:16.987941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.987941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.987941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.987941 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:16.988670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:16.988670 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:16.988978 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-775bfbee-3da9-4967-9e1d-ce9440f1bbba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '.version_select at 0x7f107d4b78b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:17.021455 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-775bfbee-3da9-4967-9e1d-ce9440f1bbba tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109809128" status: 202 len: 0 microversion: 2.1 time: 0.046041 Sep 22 12:36:17.026378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 429/874] 10.222.0.33 () {58 vars in 1221 bytes} [Thu Sep 22 12:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109809128 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:36:17.187234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:17.191884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:17.197435 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d4375aa9-d32f-4008-8f2f-fb0d499fdab4 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1452 microversion: 2.1 time: 0.231075 Sep 22 12:36:17.198188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 446/875] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:16 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:17.995484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:17.996872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:18.007702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:18.008268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:18.008947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:18.009831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:18.010706 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:18.011668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:18.247629 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:18.257787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:18.259820 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:18.261435 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4b9a43bb-74af-42d0-97e6-c75e7efe8239 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1741 microversion: 2.20 time: 0.270769 Sep 22 12:36:18.262585 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 430/876] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:17 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:19.044842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:19.045421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:19.055165 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.055740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.056407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.057346 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.057840 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.058360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.081571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a HTTP/1.1 Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:19.084332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.085949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'b913950e-49dc-4312-a031-e540dfc3a13a'} Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:19.086815 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.088214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.090627 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:19.090808 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f7463233-24ed-4dc2-a6c6-28c7f1a9e514 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 404 len: 111 microversion: 2.1 time: 0.049958 Sep 22 12:36:19.092799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 447/877] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:19 2022] DELETE /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:36:19.103266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:19.103762 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: b913950e-49dc-4312-a031-e540dfc3a13a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:19.110792 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.112040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.112761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.113636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.114243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.114832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.132489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a HTTP/1.1 Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:19.134249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.135572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'b913950e-49dc-4312-a031-e540dfc3a13a'} Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:19.136369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. Sep 22 12:36:19.137569 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:19.138705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance b913950e-49dc-4312-a031-e540dfc3a13a could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:19.138705 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d826a73c-c8db-4143-a574-c2126f335c3c tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a" status: 404 len: 111 microversion: 2.1 time: 0.037595 Sep 22 12:36:19.139616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 431/878] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:19 2022] GET /compute/v2.1/servers/b913950e-49dc-4312-a031-e540dfc3a13a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:19.288524 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:19.289342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:19.295578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.296064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.296529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.297240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.297677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.298101 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.450678 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca03754-f373-43f1-b251-20165efd6733", "tag": "48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:19.466831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:19.467884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:19.468527 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:19.486757 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:19.488129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] Creating event network-changed:48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f for instance cca03754-f373-43f1-b251-20165efd6733 on hv-cinder-85646 Sep 22 12:36:19.495177 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-8d78447f-61ef-45e1-8fa6-66959c63a484 req-df8124b2-272a-4af3-aafa-67e587464c57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055892 Sep 22 12:36:19.495428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:19.496321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 432/879] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:19.497507 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:19.498755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e8de45a3-336d-483f-b8ed-be16a9902054 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1723 microversion: 2.20 time: 0.214649 Sep 22 12:36:19.499287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 448/880] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:19 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:20.300091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:20.300790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:20.311996 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.312624 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.313335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.314589 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.315293 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.315722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.330078 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 HTTP/1.1 Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:20.331918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.333509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '71cc8e1d-1561-4c72-a891-28be6d887da5'} Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:20.336991 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.338235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.339478 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:20.339478 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-74d790da-d443-4d16-9114-1200d48e1f65 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 404 len: 111 microversion: 2.1 time: 0.039081 Sep 22 12:36:20.339478 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 433/881] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:20 2022] DELETE /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:20.342511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:20.343119 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 71cc8e1d-1561-4c72-a891-28be6d887da5] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:20.354487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.355005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.355441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.356156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.356708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.357132 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.372907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 HTTP/1.1 Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:20.374783 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.377025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '71cc8e1d-1561-4c72-a891-28be6d887da5'} Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:20.378062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. Sep 22 12:36:20.379510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.380863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 71cc8e1d-1561-4c72-a891-28be6d887da5 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:20.380863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-43cee796-e813-45e3-b656-77dcdd6029f6 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5" status: 404 len: 111 microversion: 2.1 time: 0.038139 Sep 22 12:36:20.380863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 449/882] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:20 2022] GET /compute/v2.1/servers/71cc8e1d-1561-4c72-a891-28be6d887da5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:20.385760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:20.386344 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:20.393219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.393764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.394203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.395318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.395797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.396262 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.412685 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 HTTP/1.1 Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:20.414305 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.415914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'd298c197-bf2c-41e0-a0d0-f0f48e979904'} Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:20.416784 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.418296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.419830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:20.419830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8f806e9-ed92-469b-92d2-3e5ace5d15f0 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 404 len: 111 microversion: 2.1 time: 0.034198 Sep 22 12:36:20.419830 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 434/883] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:20 2022] DELETE /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:20.426319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:20.426944 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: d298c197-bf2c-41e0-a0d0-f0f48e979904] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:20.433429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.433924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.434353 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.435052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.435496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.435915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.451225 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 HTTP/1.1 Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:20.452813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.454455 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'd298c197-bf2c-41e0-a0d0-f0f48e979904'} Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:20.457213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. Sep 22 12:36:20.458746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:20.460426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance d298c197-bf2c-41e0-a0d0-f0f48e979904 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:20.460426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-75d38f17-ba9f-4d45-aebb-6c97448e3ab9 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904" status: 404 len: 111 microversion: 2.1 time: 0.032923 Sep 22 12:36:20.460426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 450/884] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:20 2022] GET /compute/v2.1/servers/d298c197-bf2c-41e0-a0d0-f0f48e979904 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:20.529027 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:20.529829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:20.537419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.537920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.538371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.539093 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:20.539534 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:20.539951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:20.733733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:20.746732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:20.748661 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:20.750097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f792f313-d0d5-4da8-b18a-29c647b6f7e4 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1723 microversion: 2.20 time: 0.225075 Sep 22 12:36:20.750645 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 435/885] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:20 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:21.631250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:21.631819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:21.638708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.639306 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.640141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.641044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.641475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.642002 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.657326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 HTTP/1.1 Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:21.659268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.661139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '9ac05188-579c-4644-89f8-233e046b4618'} Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:21.662125 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.663577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.665856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:21.666793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-27eece23-9455-41ff-a118-d32ee90b5c04 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 404 len: 111 microversion: 2.1 time: 0.040326 Sep 22 12:36:21.667984 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 451/886] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:36:21 2022] DELETE /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:21.676878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:21.678206 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] [instance: 9ac05188-579c-4644-89f8-233e046b4618] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:21.685632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.686424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.687040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.687902 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.688682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.690179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.776957 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:21.777786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:21.791284 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.791831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.792339 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.793223 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.793555 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:21.794039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:21.889602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] HTTP exception thrown: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Request method failure captured: Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 HTTP/1.1 Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFUe4nBD7LpJcCN9ieLVAO_b0g81lFb6s71l95UsQMRs4fryyI5xIWmr6AlOTV8jisFvaXl9qi8oNUJyMZ24z0-UrqUiGbNLnjdS0dmvAvSwaO1jLskCjBBwu8fxnDzSkGgyYOMnyafkzZgItvOqkfmISASwxoxwzXzvfb-M36AxHaE Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:21.891301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/40ddbbe59b90403fb3ea9212d10727aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_40ddbbe59b90403fb3ea9212d10727aa"}]}] Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 40ddbbe59b90403fb3ea9212d10727aa Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1013501470 Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 55a7f7ba0b27479f8d1e68d808637d55 Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeNegativeTest-1013501470-project Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.893079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '9ac05188-579c-4644-89f8-233e046b4618'} Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:21.894013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. Sep 22 12:36:21.895407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:21.897159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] Returning 404 to user: Instance 9ac05188-579c-4644-89f8-233e046b4618 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:21.897159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-45845fd4-fa78-4b53-85b0-be2686ea49b8 tempest-AttachVolumeNegativeTest-1013501470 tempest-AttachVolumeNegativeTest-1013501470-project] 10.222.0.33 "GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618" status: 404 len: 111 microversion: 2.1 time: 0.221549 Sep 22 12:36:21.897159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 436/887] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:36:21 2022] GET /compute/v2.1/servers/9ac05188-579c-4644-89f8-233e046b4618 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 22 12:36:21.951193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:21.960177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:21.961850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:21.963216 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c04fd568-a3ca-4bc5-82e6-40902ba5a5ce tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1666 microversion: 2.20 time: 0.190814 Sep 22 12:36:21.963755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 452/888] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:21 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1666 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:21.989799 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bab157a2-d752-4cf5-a681-96ab7a5fcf91"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:21.992313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:21.999452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:21.999948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.000425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.001157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.001653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.002087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.347101 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a4d1c2f-1cc1-4f26-adaa-07cfa8a9ec9c tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362078 Sep 22 12:36:22.347968 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 437/889] 10.222.0.33 () {62 vars in 1364 bytes} [Thu Sep 22 12:36:21 2022] POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 22 12:36:22.497454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:22.497942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:22.504261 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.505061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.505655 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.506548 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.507147 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.507722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.770805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-93c590e4-af73-4dfd-a160-de72d8499820 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments/bab157a2-d752-4cf5-a681-96ab7a5fcf91" status: 202 len: 0 microversion: 2.20 time: 0.277230 Sep 22 12:36:22.771637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 453/890] 10.222.0.33 () {60 vars in 1457 bytes} [Thu Sep 22 12:36:22 2022] DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments/bab157a2-d752-4cf5-a681-96ab7a5fcf91 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 12:36:22.837359 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:22.838171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:22.844866 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.845473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.846015 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.846915 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.847492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.847917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.880136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 12:36:22.955726 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ee76ae3-a6ea-4454-b1a0-5c67226d99a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/action" status: 202 len: 0 microversion: 2.20 time: 0.122249 Sep 22 12:36:22.956573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 438/891] 10.222.0.33 () {62 vars in 1319 bytes} [Thu Sep 22 12:36:22 2022] POST /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 22 12:36:22.964485 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:22.965314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:22.973696 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.974370 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.975035 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:22.975978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:22.976767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:22.977410 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:23.152624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:23.167727 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:23.169871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:23.171586 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ddced100-2249-4098-8b14-1d535f90a26a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1674 microversion: 2.20 time: 0.210926 Sep 22 12:36:23.172647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 454/892] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:22 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:24.164523 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "name": "network-vif-unplugged", "status": "completed", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:24.177439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:24.178421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:24.178853 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:24.191760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.compute.server_external_events [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] Unable to find a host for instance 5bb3c468-640c-42bf-8f8d-d93c01948176. Dropping event network-vif-unplugged {{(pid=120603) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 12:36:24.192797 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-7af56ec4-52b5-4087-aa76-5a3b242fbc0b req-3667fb1c-07b1-4aa8-abb3-8ad0f04bb810 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033461 Sep 22 12:36:24.193694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 439/893] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 22 12:36:24.199207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:24.200546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:24.209012 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:24.209730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:24.210342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:24.211214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:24.212209 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:24.213217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:24.461823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:24.475187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:24.477898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:24.479324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e066fc22-7333-4ef4-8a38-24ac696f21df tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1674 microversion: 2.20 time: 0.284238 Sep 22 12:36:24.480247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 455/894] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:24 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1674 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:25.506559 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:25.509115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:25.517508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:25.518527 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:25.519326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:25.520276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:25.520964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:25.521611 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:25.732414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:25.752075 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:25.756709 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:25.764965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1d46f39d-2ba0-46bc-ac9f-997709a4591e tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.262717 Sep 22 12:36:25.766249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 440/895] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:25 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:26.798855 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:26.799465 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:26.815753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:26.816330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:26.816751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:26.817464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:26.817926 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:26.818360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:27.089950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:27.114232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:27.120850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:27.124478 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-277d517a-320c-4eb9-b839-a3f395053e65 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.332729 Sep 22 12:36:27.126836 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 456/896] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:26 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:28.029365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4e2631fa-80fd-472c-9516-c456c7a3c802 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Action: 'create', calling method: .version_select at 0x7f1079a89e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-628253105"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:28.156556 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:28.157173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:28.169319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:28.169821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:28.170268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:28.170980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:28.171431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:28.184762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:28.407224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:28.426751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:28.429127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:28.430546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7780cb9d-8e45-49a0-a61c-1edef3fda169 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.277991 Sep 22 12:36:28.454662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 457/897] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:28 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:28.553871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4e2631fa-80fd-472c-9516-c456c7a3c802 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.697072 Sep 22 12:36:28.554628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 441/898] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Sep 22 12:36:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 698 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 22 12:36:28.568250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-23758755-2f27-40ef-981e-ea441378ee6f tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079baf280>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:28.662207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-23758755-2f27-40ef-981e-ea441378ee6f tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 200 len: 344 microversion: 2.1 time: 0.098388 Sep 22 12:36:28.662827 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 458/899] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:28 2022] GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 344 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:29.459054 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:29.459760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:29.467212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:29.467714 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:29.468150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:29.468881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:29.469414 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:29.470587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:29.659607 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:29.668883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:29.675249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:29.677025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-84e2c888-5f1d-44d6-859f-2bc8f294b9c0 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079cb51f0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:29.680481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a185f3e6-5cbd-43a9-83f3-f90f0bc210d9 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.223934 Sep 22 12:36:29.681411 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 442/900] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:29 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:29.755556 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-84e2c888-5f1d-44d6-859f-2bc8f294b9c0 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 200 len: 345 microversion: 2.1 time: 0.083509 Sep 22 12:36:29.760351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 459/901] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:29 2022] GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:29.771091 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00cb845b-0b89-4088-a63e-34c6703a3fa3 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Action: 'create', calling method: .version_select at 0x7f1079a7f1f0>, body: {"snapshot": {"volume_id": "5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-585528098"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:30.048897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00cb845b-0b89-4088-a63e-34c6703a3fa3 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.282032 Sep 22 12:36:30.049652 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 443/902] 10.222.0.33 () {60 vars in 1162 bytes} [Thu Sep 22 12:36:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:30.064745 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e52ad5e0-26f0-4c63-85c1-6092c5e86736 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079c435e0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:30.108138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e52ad5e0-26f0-4c63-85c1-6092c5e86736 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.047687 Sep 22 12:36:30.120085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 460/903] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:30 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:30.136275 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ef6e5d1b-5130-4455-804f-f11a2a652519 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079a89c10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:30.187622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ef6e5d1b-5130-4455-804f-f11a2a652519 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.059596 Sep 22 12:36:30.188388 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 444/904] 10.222.0.33 () {58 vars in 1140 bytes} [Thu Sep 22 12:36:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:30.203391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7934390e-a9d1-49b7-9e2c-c327b289b606 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079cb50d0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:30.254006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7934390e-a9d1-49b7-9e2c-c327b289b606 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.055120 Sep 22 12:36:30.254980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 461/905] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:30 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:30.708931 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:30.709549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:30.718844 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:30.719625 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:30.720260 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:30.721297 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:30.721946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:30.722376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:30.906660 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:30.919353 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:30.922458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:30.927911 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c1e48741-6681-435a-b938-35a579f3f8fd tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.222769 Sep 22 12:36:30.932628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 445/906] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:30 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:31.267558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-835006c5-60f6-4c83-9a13-d12efdb0d5ff tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079baf820>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:31.300672 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-835006c5-60f6-4c83-9a13-d12efdb0d5ff tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.037308 Sep 22 12:36:31.305987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 462/907] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:31 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:31.956401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:31.957144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:31.965579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:31.966702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:31.967793 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:31.968976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:31.970565 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:31.971655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:32.007179 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:32.164252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:32.174313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:32.176044 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:32.177477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6dae2bec-da9a-4f69-8393-eab1ac510fe5 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.225929 Sep 22 12:36:32.178720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 446/908] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:31 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:32.313237 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-852a79b9-5185-4983-b469-716e60ac732d tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079976e50>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:32.357689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-852a79b9-5185-4983-b469-716e60ac732d tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.048124 Sep 22 12:36:32.358538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 463/909] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:32 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:33.205853 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:33.206507 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:33.213842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:33.214594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:33.222470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:33.223473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:33.224113 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:33.225698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:33.371829 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-43678ed0-dea9-4f84-bb40-ab5b540f89f0 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079cb5ca0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:33.389266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:33.391383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:33.393446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:33.394612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-35c7bcfe-0dc2-4b46-96f2-ea72b46e62a8 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.194176 Sep 22 12:36:33.400516 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 447/910] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:33 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:33.404938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-43678ed0-dea9-4f84-bb40-ab5b540f89f0 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.037060 Sep 22 12:36:33.406467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 464/911] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:33 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:34.421335 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:34.424970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7720daac-b230-499c-bb9e-fe5009f20f20 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079a89670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:34.429144 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:34.440854 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:34.441473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:34.442015 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:34.442889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:34.443966 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:34.444606 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:34.461270 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7720daac-b230-499c-bb9e-fe5009f20f20 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 287 microversion: 2.1 time: 0.047335 Sep 22 12:36:34.461923 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 448/912] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:34 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:34.473819 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7e93bba-d807-47c6-aa26-3519aac3ca31 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079a7f4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:34.545176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7e93bba-d807-47c6-aa26-3519aac3ca31 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 202 len: 0 microversion: 2.1 time: 0.075619 Sep 22 12:36:34.546107 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 449/913] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Sep 22 12:36:34 2022] DELETE /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 12:36:34.554440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e5a1f14e-415e-42fb-bcb5-07b68ba9a4a1 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f107d457ee0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:34.600236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e5a1f14e-415e-42fb-bcb5-07b68ba9a4a1 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 200 len: 286 microversion: 2.1 time: 0.049609 Sep 22 12:36:34.606254 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 450/914] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:34 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:34.654830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:34.665973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:34.670324 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:34.671821 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9860cd82-f08a-4510-84ae-59e143e1d470 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.254798 Sep 22 12:36:34.672395 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 465/915] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:34 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:35.614659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c7b4029-eb2b-48d3-9d17-349e7e2c08e5 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079a890d0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:35.644570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-4c7b4029-eb2b-48d3-9d17-349e7e2c08e5 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] HTTP exception thrown: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c7b4029-eb2b-48d3-9d17-349e7e2c08e5 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Request method failure captured: Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 HTTP/1.1 Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFbLDb9cOXihOUth7vGOndcQMXG_58QJzsHjqOv59LZ6DdQ74CREjHKqVDnYnXLsZHttP1IaKHRd0j-6y4YS95XITagVGHVsoaeulXVhVZ8bQdlcucmESpgd9EtflgvalMENk-Kuo69dTJLOYIsIpFVSJBEWS5ihtbCpJhiwfh7NgVo Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:35.647181 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/862082d6e756429ea5829677b8100dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_862082d6e756429ea5829677b8100dcc"}]}] Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 9af80c1235db4ebaaf30ba33c1e93d1b Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '463fe643-58b1-4120-9cba-c413058e13f9'} Sep 22 12:36:35.648988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. (HTTP 404) (Request-ID: req-6ef45cd7-476a-4e53-bbeb-a6f2bce7d350) Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.650035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:35.651481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 22 12:36:35.652861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. Sep 22 12:36:35.654376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:35.656592 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4c7b4029-eb2b-48d3-9d17-349e7e2c08e5 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Returning 404 to user: Snapshot 463fe643-58b1-4120-9cba-c413058e13f9 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:35.658298 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4c7b4029-eb2b-48d3-9d17-349e7e2c08e5 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9" status: 404 len: 111 microversion: 2.1 time: 0.048926 Sep 22 12:36:35.658836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 451/916] 10.222.0.33 () {58 vars in 1251 bytes} [Thu Sep 22 12:36:35 2022] GET /compute/v2.1/os-snapshots/463fe643-58b1-4120-9cba-c413058e13f9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:35.667611 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-56b3564b-edb1-423e-8823-6f2e863c010b tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079cb5430>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:35.706350 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:35.707799 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:35.714340 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:35.714843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:35.715289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:35.716002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:35.716504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:35.716929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:35.744848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-56b3564b-edb1-423e-8823-6f2e863c010b tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 202 len: 0 microversion: 2.1 time: 0.081234 Sep 22 12:36:35.745460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 466/917] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:36:35 2022] DELETE /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:36:35.754214 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-34e2e299-811e-41ac-9b68-f6df41fab38a tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079bf21f0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:35.805617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-34e2e299-811e-41ac-9b68-f6df41fab38a tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 200 len: 344 microversion: 2.1 time: 0.055263 Sep 22 12:36:35.806189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 467/918] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:35 2022] GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:35.861278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:35.870193 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:35.871636 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:35.872834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-036b5428-ba9b-4878-9e76-684ac2edb6e0 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.170454 Sep 22 12:36:35.873399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 452/919] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:35 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:36.821124 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-369a09a4-bd28-4fe3-b108-1af458fe051e tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079baf310>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:36.849393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-369a09a4-bd28-4fe3-b108-1af458fe051e tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] HTTP exception thrown: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-369a09a4-bd28-4fe3-b108-1af458fe051e tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Request method failure captured: Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f HTTP/1.1 Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFbLDb9cOXihOUth7vGOndcQMXG_58QJzsHjqOv59LZ6DdQ74CREjHKqVDnYnXLsZHttP1IaKHRd0j-6y4YS95XITagVGHVsoaeulXVhVZ8bQdlcucmESpgd9EtflgvalMENk-Kuo69dTJLOYIsIpFVSJBEWS5ihtbCpJhiwfh7NgVo Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:36:36.851377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/862082d6e756429ea5829677b8100dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_862082d6e756429ea5829677b8100dcc"}]}] Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 9af80c1235db4ebaaf30ba33c1e93d1b Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f'} Sep 22 12:36:36.853282 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. (HTTP 404) (Request-ID: req-b9332b2c-76e7-4882-b881-284279180b99) Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.854352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:36.855833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 12:36:36.857036 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-369a09a4-bd28-4fe3-b108-1af458fe051e tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Returning 404 to user: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-369a09a4-bd28-4fe3-b108-1af458fe051e tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 404 len: 109 microversion: 2.1 time: 0.035827 Sep 22 12:36:36.858268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 468/920] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:36 2022] GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:36.868387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6954c272-0804-4716-8866-d62ef8339506 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079a7f4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:36.898375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-6954c272-0804-4716-8866-d62ef8339506 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] HTTP exception thrown: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.900433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:36.901054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6954c272-0804-4716-8866-d62ef8339506 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Request method failure captured: Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f HTTP/1.1 Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFbLDb9cOXihOUth7vGOndcQMXG_58QJzsHjqOv59LZ6DdQ74CREjHKqVDnYnXLsZHttP1IaKHRd0j-6y4YS95XITagVGHVsoaeulXVhVZ8bQdlcucmESpgd9EtflgvalMENk-Kuo69dTJLOYIsIpFVSJBEWS5ihtbCpJhiwfh7NgVo Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:36.901969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/862082d6e756429ea5829677b8100dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_862082d6e756429ea5829677b8100dcc"}]}] Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 9af80c1235db4ebaaf30ba33c1e93d1b Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f'} Sep 22 12:36:36.903540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. (HTTP 404) (Request-ID: req-b0ec7c1b-9639-4f6c-80d1-2d2d482b5bec) Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.904787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 22 12:36:36.906238 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 22 12:36:36.909119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6954c272-0804-4716-8866-d62ef8339506 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Returning 404 to user: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:36.911318 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6954c272-0804-4716-8866-d62ef8339506 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 404 len: 109 microversion: 2.1 time: 0.038893 Sep 22 12:36:36.913385 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:36.913549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 453/921] 10.222.0.33 () {58 vars in 1248 bytes} [Thu Sep 22 12:36:36 2022] DELETE /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:36.913650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:36.913650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:36.913650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:36.913650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:36.914236 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:36.914384 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00a0519b-7826-4a4d-a06d-950cd108a602 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Calling method '.version_select at 0x7f1079abac10>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:36.946944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-00a0519b-7826-4a4d-a06d-950cd108a602 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] HTTP exception thrown: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00a0519b-7826-4a4d-a06d-950cd108a602 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Request method failure captured: Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f HTTP/1.1 Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFbLDb9cOXihOUth7vGOndcQMXG_58QJzsHjqOv59LZ6DdQ74CREjHKqVDnYnXLsZHttP1IaKHRd0j-6y4YS95XITagVGHVsoaeulXVhVZ8bQdlcucmESpgd9EtflgvalMENk-Kuo69dTJLOYIsIpFVSJBEWS5ihtbCpJhiwfh7NgVo Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:36:36.949420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/862082d6e756429ea5829677b8100dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/862082d6e756429ea5829677b8100dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_862082d6e756429ea5829677b8100dcc"}]}] Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 862082d6e756429ea5829677b8100dcc Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-983595531 Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 9af80c1235db4ebaaf30ba33c1e93d1b Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-983595531-project Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f'} Sep 22 12:36:36.950749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. (HTTP 404) (Request-ID: req-976b5f81-1091-471f-b51d-b234716fde6f) Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.951767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 22 12:36:36.953826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 22 12:36:36.955211 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. Sep 22 12:36:36.956572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:36:36.960134 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-00a0519b-7826-4a4d-a06d-950cd108a602 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] Returning 404 to user: Volume 5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:36:36.961180 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-00a0519b-7826-4a4d-a06d-950cd108a602 tempest-VolumesSnapshotsTestJSON-983595531 tempest-VolumesSnapshotsTestJSON-983595531-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f" status: 404 len: 109 microversion: 2.1 time: 0.052032 Sep 22 12:36:36.962370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 454/922] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:36 2022] GET /compute/v2.1/os-volumes/5b7f1fc3-57b6-4967-9483-a7b1ade3ef5f => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:36:37.077718 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:37.088209 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:37.089680 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:37.090883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-20283026-2f0d-4418-a83c-461e9b76839b tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.195798 Sep 22 12:36:37.091432 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 469/923] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:36 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:38.118407 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:38.119287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:38.126894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:38.127301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:38.127921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:38.128755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:38.129222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:38.129656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:38.291476 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:38.300740 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:38.302207 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:38.303399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4fcc8150-480f-4829-b005-cf0dde99a970 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.189585 Sep 22 12:36:38.303941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 455/924] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:38 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:39.328825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:39.329471 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:39.336182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:39.336707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:39.337142 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:39.337830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:39.338278 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:39.338704 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:39.464060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:39.472735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:39.474181 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:39.475336 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-98ae009d-79a1-4c0d-84ff-75aaf2ee9129 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.150730 Sep 22 12:36:39.475879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 470/925] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:39 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:39.775668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a499f1d-bad4-43f1-91cb-c2f44d40eb3e tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079bb6700>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:39.823250 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a499f1d-bad4-43f1-91cb-c2f44d40eb3e tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/c8739029-b3f8-4a99-a5cc-52fbc807617e" status: 200 len: 351 microversion: 2.1 time: 0.051231 Sep 22 12:36:39.823802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 456/926] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:39 2022] GET /compute/v2.1/os-volumes/c8739029-b3f8-4a99-a5cc-52fbc807617e => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:40.501535 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:40.502813 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:40.506549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=52 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:40.510310 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:40.510787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:40.511347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:40.512189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:40.512667 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:40.513085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:40.681788 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:40.690309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:40.692128 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:40.693528 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1be122d7-b20c-4640-aa4c-a6ced720b698 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.196240 Sep 22 12:36:40.694286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 471/927] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:40 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:41.175400 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-aa2b014e-40a5-446d-82b8-9634c08b4e51 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079a7f940>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:41.222884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-aa2b014e-40a5-446d-82b8-9634c08b4e51 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/930ddf31-6fc2-43e1-a1ce-40abf7817323" status: 200 len: 350 microversion: 2.1 time: 0.051846 Sep 22 12:36:41.223515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 457/928] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:41 2022] GET /compute/v2.1/os-volumes/930ddf31-6fc2-43e1-a1ce-40abf7817323 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:41.718931 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:41.719657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:41.726461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:41.726949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:41.727386 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:41.728361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:41.728816 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:41.729444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:41.865546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:41.874344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:41.876726 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:41.877895 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-00e5f711-7407-4bb3-9eb7-f250b846be76 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.162896 Sep 22 12:36:41.878442 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 472/929] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:41 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:42.274025 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "name": "network-vif-plugged", "status": "completed", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:36:42.281457 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:42.287817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:42.288642 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:42.289289 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:42.301236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] Creating event network-vif-plugged:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:36:42.307277 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-9fd93166-1e11-4bf8-ab73-582d2ea088ef req-0e65ccb6-2cdb-4fc9-9686-37cfab0b896d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037122 Sep 22 12:36:42.308397 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 458/930] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:42.584154 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-15756ca9-b41b-492a-a3f4-4c79d476e57f tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079baf9d0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:42.630447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-15756ca9-b41b-492a-a3f4-4c79d476e57f tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a1555217-fd28-4ede-a8f1-968451dbfe1d" status: 200 len: 351 microversion: 2.1 time: 0.049992 Sep 22 12:36:42.630991 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 473/931] 10.222.0.33 () {58 vars in 1245 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/os-volumes/a1555217-fd28-4ede-a8f1-968451dbfe1d => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:42.645392 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a515d2bd-e7c8-47ba-9046-66919b4447a1 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079aba4c0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:42.726990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a515d2bd-e7c8-47ba-9046-66919b4447a1 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086797 Sep 22 12:36:42.727798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 459/932] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:42.742537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38526b06-8590-44b4-8fd7-75481628bec4 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079b859d0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:42.822557 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38526b06-8590-44b4-8fd7-75481628bec4 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084174 Sep 22 12:36:42.823186 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 474/933] 10.222.0.33 () {58 vars in 1149 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:42.836811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bbf32f69-51fc-454c-800e-dc2602e92471 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079ad8ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:42.902967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:42.903579 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:42.910911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:42.911399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:42.911852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:42.912559 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:42.913016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:42.913444 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:42.916916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bbf32f69-51fc-454c-800e-dc2602e92471 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083765 Sep 22 12:36:42.917474 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 460/934] 10.222.0.33 () {58 vars in 1134 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:42.931217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9958fbe4-add1-4a31-b0af-fa65e3c98e8c tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079a898b0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:43.015117 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9958fbe4-add1-4a31-b0af-fa65e3c98e8c tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087557 Sep 22 12:36:43.015672 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 461/935] 10.222.0.33 () {58 vars in 1167 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:43.028986 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eb46ad6c-9eb5-4828-81b9-fbd290fd8bed tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079abaa60>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:43.061594 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:43.063852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:36:43.071824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:43.073640 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:43.074789 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-eb791eca-74e9-4db7-a41c-ed71ca969a0a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.175731 Sep 22 12:36:43.075340 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 475/936] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:42 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:36:43.116156 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eb46ad6c-9eb5-4828-81b9-fbd290fd8bed tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090807 Sep 22 12:36:43.116763 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 462/937] 10.222.0.33 () {58 vars in 1170 bytes} [Thu Sep 22 12:36:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:36:43.131023 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4bc4085b-06be-4259-acf7-641914a8e0c9 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079baf8b0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:43.210619 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4bc4085b-06be-4259-acf7-641914a8e0c9 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084037 Sep 22 12:36:43.211184 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 476/938] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Sep 22 12:36:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:43.225284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b638c86-bad9-4442-924a-e8fbaf8b3637 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079a87670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:43.308069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b638c86-bad9-4442-924a-e8fbaf8b3637 tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086536 Sep 22 12:36:43.308653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 463/939] 10.222.0.33 () {58 vars in 1188 bytes} [Thu Sep 22 12:36:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:36:43.324764 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a15e83e3-7906-4c5e-bf4d-816e9073f04b tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] Calling method '.version_select at 0x7f1079c0c4c0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:43.409916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a15e83e3-7906-4c5e-bf4d-816e9073f04b tempest-VolumesTestJSON-1684240268 tempest-VolumesTestJSON-1684240268-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089231 Sep 22 12:36:43.410489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 477/940] 10.222.0.33 () {58 vars in 1155 bytes} [Thu Sep 22 12:36:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:36:44.099698 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:44.100471 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:44.107307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:44.107804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:44.108246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:44.109003 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:44.109537 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:44.109971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:44.245000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:44.254338 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:44.255758 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:44.256934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ce297e6b-a810-4c11-b0bf-963648e46716 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1732 microversion: 2.20 time: 0.161139 Sep 22 12:36:44.257482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 464/941] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:44 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:36:45.282850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:36:45.286921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:36:45.292847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:45.293344 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:45.293782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:45.294483 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:36:45.294932 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:36:45.295383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:36:45.437870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:45.446279 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:45.447719 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:36:45.448905 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b38eddcb-cf27-4d11-b938-bc6c880dea1a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1719 microversion: 2.20 time: 0.170612 Sep 22 12:36:45.449452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 478/942] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:36:45 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:37:24.145037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:24.147874 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:24.150510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:24.151374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=28 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:24.157772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.158473 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.159115 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.159920 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.160943 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.161370 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.201120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-97a46b57-feff-4e5d-93f9-8ea1a81d1a13 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060626 Sep 22 12:37:24.204346 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 465/943] 10.222.0.33 () {60 vars in 1343 bytes} [Thu Sep 22 12:37:24 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:24.273064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:24.274200 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:24.277850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:24.278661 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=7 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:24.282404 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.283076 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.283706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.284607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.285751 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.286388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.314126 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:37:24.419772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b677c388-6414-4208-b53e-c294764aecb6 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 204 len: 0 microversion: 2.20 time: 0.149920 Sep 22 12:37:24.420860 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 479/944] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 22 12:37:24 2022] DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 12:37:24.429817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:24.431148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:24.441185 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.441752 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.442192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.442894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:24.443347 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:24.443935 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:24.613544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:24.624223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:24.626456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:24.627964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-920c330e-10eb-47dc-8dd9-64f060523f04 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.202780 Sep 22 12:37:24.628786 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 466/945] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:24 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 22 12:37:25.658837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:25.661081 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:25.668486 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:25.669059 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:25.669595 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:25.670647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:25.671313 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:25.671973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:25.818106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:25.830549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:25.832418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:25.833805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fede784b-e3bb-4a07-ad8b-7fc598791acc tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1725 microversion: 2.20 time: 0.180303 Sep 22 12:37:25.834939 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 480/946] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:25 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:37:26.774245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6d25f062-baa0-4905-8688-24588b837444 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'create', calling method: .version_select at 0x7f1079a53280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1510588056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgPZupzdwZPLXj3exf5iz1fJ6jH0aJGvobIr0QVxIKvCVVlA1in8NcSE9LLua1j9ChGgP0gTNmJgSZ+fKF/kjsqvXvRV6cM56ZX6/5mTnuZP3PbsZRBCkIZ7Z5ftHirtQ=="}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:26.790412 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-6d25f062-baa0-4905-8688-24588b837444 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Getting quotas for project 4793b91c7212484c84960201b2d39114. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:37:26.794393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-6d25f062-baa0-4905-8688-24588b837444 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Getting quotas for user 1c6957aac61b4ed985e2dafc888c4b6a and project 4793b91c7212484c84960201b2d39114. Resources: {'key_pairs'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:37:26.818379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6d25f062-baa0-4905-8688-24588b837444 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048041 Sep 22 12:37:26.819096 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 467/947] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:37:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:26.860454 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:26.861736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:26.870447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:26.871461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:26.872491 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:26.873418 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:26.874070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:26.874692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:26.930859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1151801127", "imageRef": "3717ae4c-499c-4887-920c-66808fc90167", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1510588056", "networks": [{"uuid": "e89c96bb-2591-4e0c-beb0-c9cf50d0fbba"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:26.967007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:26.980005 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:26.981458 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:26.982653 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-52ed83de-49d1-4beb-a0ce-48b5f79a6e14 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1657 microversion: 2.20 time: 0.126477 Sep 22 12:37:26.983187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 481/948] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:26 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1657 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:37:26.990090 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] validate_networks() for [('e89c96bb-2591-4e0c-beb0-c9cf50d0fbba', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:37:27.312625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c468-640c-42bf-8f8d-d93c01948176", "name": "network-vif-deleted", "tag": "4a27a044-392f-4a27-8b97-338680c1a580"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:27.334358 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:27.335262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:27.335945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:27.352120 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] Creating event network-vif-deleted:4a27a044-392f-4a27-8b97-338680c1a580 for instance 5bb3c468-640c-42bf-8f8d-d93c01948176 on hv-cinder-85646 Sep 22 12:37:27.359468 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-75c8c287-bb89-4fc1-859b-919fabfff95d req-1f88e959-4fa1-41fe-986e-f390fab3e8a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056878 Sep 22 12:37:27.361203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 482/949] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:27.551321 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:37:27.551829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:37:27.552398 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:37:27.552904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:37:27.553387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:37:27.562303 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:27.562877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:27.563377 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:27.564173 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:27.564719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:27.565150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:27.581738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Getting quotas for project 4793b91c7212484c84960201b2d39114. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:37:27.586477 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Getting quotas for user 1c6957aac61b4ed985e2dafc888c4b6a and project 4793b91c7212484c84960201b2d39114. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:37:27.599755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:37:27.603497 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3717ae4c-499c-4887-920c-66808fc90167',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:37:27.650003 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cb34ad58-c6db-44f9-b601-f52a950f72f6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722950 Sep 22 12:37:27.651059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 468/950] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:37:27.668020 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8207e5af-467e-4ecb-923f-20555a90d8b2 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:27.671287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8207e5af-467e-4ecb-923f-20555a90d8b2 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:27.755593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-8207e5af-467e-4ecb-923f-20555a90d8b2 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:27.763323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8207e5af-467e-4ecb-923f-20555a90d8b2 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1259 microversion: 2.1 time: 0.104492 Sep 22 12:37:27.764652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 483/951] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:27 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1259 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:28.009897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:28.010723 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:28.023214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:28.023953 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:28.024621 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:28.025521 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:28.026141 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:28.026754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:28.069404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:28.069894 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:28.070330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:28.070783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lazy-loading 'fault' on Instance uuid 5bb3c468-640c-42bf-8f8d-d93c01948176 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:37:28.124829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:28.137026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:28.139948 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '262e5327ba144a6287fef6dd6293f886', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '553395befb8f4c958d34b7dffb2317e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:28.141947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-df60dc51-8393-4d24-8f17-43ab19933923 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 200 len: 1372 microversion: 2.20 time: 0.136397 Sep 22 12:37:28.143035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 469/952] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:28 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 22 12:37:28.787353 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:28.788242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:28.796110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:28.796666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:28.797083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:28.798909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:28.799400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:28.799822 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:28.874078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:28.883111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1113e93d-df36-4c98-b1e5-074129b38d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1311 microversion: 2.1 time: 0.099981 Sep 22 12:37:28.909876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 484/953] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:28 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:29.167365 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:29.168061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:29.174826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:29.175315 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:29.175781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:29.176519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:29.176973 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:29.177393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:29.192729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 HTTP/1.1 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:37:29.194380 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:29.196092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '5bb3c468-640c-42bf-8f8d-d93c01948176'} Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:37:29.197382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:29.199169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:29.201151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:37:29.201151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-62c65e58-8505-4133-b4a4-92db4427d09a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 404 len: 111 microversion: 2.20 time: 0.032357 Sep 22 12:37:29.201151 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 470/954] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:29 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:37:29.204612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-327be234-87bd-4c3f-b2c0-4246cb04a7e3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '.version_select at 0x7f1079b858b0>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:29.209870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR oslo.messaging._drivers.impl_rabbit [None req-327be234-87bd-4c3f-b2c0-4246cb04a7e3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [7f757e41-cc55-4348-aa33-c4b52fb3d936] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 12:37:29.918415 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:29.919420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:29.933439 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:29.934352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:29.935019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:29.936540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:29.937242 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:29.937912 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:30.106547 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:30.116767 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-29bdea3f-6b35-4276-be59-2fc0475bb628 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.202198 Sep 22 12:37:30.118038 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 471/955] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:29 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:30.217861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [None req-327be234-87bd-4c3f-b2c0-4246cb04a7e3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [7f757e41-cc55-4348-aa33-c4b52fb3d936] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 57722. Sep 22 12:37:30.246584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-327be234-87bd-4c3f-b2c0-4246cb04a7e3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708258262" status: 204 len: 0 microversion: 2.20 time: 1.045748 Sep 22 12:37:30.247710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 485/956] 10.222.0.33 () {60 vars in 1262 bytes} [Thu Sep 22 12:37:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708258262 => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 22 12:37:31.140178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:31.140869 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:31.147890 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:31.148393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:31.148832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:31.149526 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:31.149982 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:31.150410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:31.295655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:31.304100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-76783fda-a46c-43d8-9448-8a631774b38f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.167907 Sep 22 12:37:31.304737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 472/957] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:31 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:32.121761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:32.122973 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:32.135146 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.136118 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.136677 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.137487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.138175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.138664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.155701 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 HTTP/1.1 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:37:32.158152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.159865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '5bb3c468-640c-42bf-8f8d-d93c01948176'} Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:37:32.161894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.163707 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.165474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:37:32.165474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0da5ad51-e22d-4a39-93c8-00e23c2f53a3 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 404 len: 111 microversion: 2.20 time: 0.041933 Sep 22 12:37:32.165474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 486/958] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 22 12:37:32 2022] DELETE /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:37:32.169049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:32.169657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 5bb3c468-640c-42bf-8f8d-d93c01948176] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:32.176230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.176756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.178208 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.178954 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.179427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.179861 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.196500 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 HTTP/1.1 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:37:32.198088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.199718 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '5bb3c468-640c-42bf-8f8d-d93c01948176'} Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:37:32.200619 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. Sep 22 12:37:32.202140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:32.203492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 5bb3c468-640c-42bf-8f8d-d93c01948176 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:37:32.203492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-47cb9ad0-2b55-4228-b1fc-06395fffbd6a tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176" status: 404 len: 111 microversion: 2.20 time: 0.034574 Sep 22 12:37:32.203492 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 473/959] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:32 2022] GET /compute/v2.1/servers/5bb3c468-640c-42bf-8f8d-d93c01948176 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:37:32.330453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:32.331392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:32.337989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.338474 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.338911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.339870 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:32.340348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:32.340776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:32.488640 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:32.496832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5d2645c9-4d31-4178-9f6a-d4f1bb912623 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.171408 Sep 22 12:37:32.497513 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 487/960] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:32 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:33.368811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:33.369989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:33.376993 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.377612 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.378150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.378994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.379546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.380035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.393925 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 HTTP/1.1 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:37:33.395583 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.397266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': '15c97c51-b54b-48e0-9929-cc535246eb97'} Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:37:33.398162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.399615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.401176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:37:33.401176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b2caea76-9752-4382-bb7f-184f94558a74 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 404 len: 111 microversion: 2.20 time: 0.032131 Sep 22 12:37:33.401176 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 474/961] 10.222.0.33 () {60 vars in 1280 bytes} [Thu Sep 22 12:37:33 2022] DELETE /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:37:33.413351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:33.415030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] [instance: 15c97c51-b54b-48e0-9929-cc535246eb97] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:33.422997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.423571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.424069 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.424915 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.425421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.426620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.443115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] HTTP exception thrown: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Request method failure captured: Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 HTTP/1.1 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFVr1lIp8zwdVOgUlbRhT919zzO7paK6rc5N9YsYwZgCCCHnH7xaeifBgyac0Pcj7heCKMURnNPqq6mqKIe4ip9ji_eyqhkXrVDItmsRQRqPAEgZ-xsHu79Mhf2Vfdh-lO1EpZG1HpyxzDl-_F6meAGXR25EDjwmQaegCgzAUkHfoug Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Openstack-Nova-Api-Version: 2.20 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:37:33.445329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/553395befb8f4c958d34b7dffb2317e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_553395befb8f4c958d34b7dffb2317e7"}]}] Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 553395befb8f4c958d34b7dffb2317e7 Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-732278441 Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 262e5327ba144a6287fef6dd6293f886 Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-AttachVolumeShelveTestJSON-732278441-project Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.446785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '15c97c51-b54b-48e0-9929-cc535246eb97'} Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:37:33.447576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. Sep 22 12:37:33.448848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:37:33.450742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] Returning 404 to user: Instance 15c97c51-b54b-48e0-9929-cc535246eb97 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:37:33.450742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-931fab84-f38c-48c5-93dc-f64e0679f1f2 tempest-AttachVolumeShelveTestJSON-732278441 tempest-AttachVolumeShelveTestJSON-732278441-project] 10.222.0.33 "GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97" status: 404 len: 111 microversion: 2.20 time: 0.042380 Sep 22 12:37:33.450742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 488/962] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Sep 22 12:37:33 2022] GET /compute/v2.1/servers/15c97c51-b54b-48e0-9929-cc535246eb97 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 22 12:37:33.526963 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:33.527745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:33.534440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.536024 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.536727 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.537805 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:33.538708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:33.539469 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:33.713148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:33.723355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f6c009fb-a876-433d-80f9-723b7e53ef39 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.201658 Sep 22 12:37:33.740929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 475/963] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:33 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:34.750265 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:34.750880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:34.759361 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 12:37:34.759786 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Thu Sep 22 12:37:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a (ip 10.222.0.33) !!! Sep 22 12:37:34.762810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:34.763833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:34.764479 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:34.765383 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:34.766051 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:34.766633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:34.980877 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:34.990428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e0da81de-3324-4711-bd38-230c88844945 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.243969 Sep 22 12:37:34.991152 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 489/964] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:34 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:36.015092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:36.016133 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:36.024375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:36.025223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:36.026286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:36.027390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:36.028935 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:36.029594 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:36.198420 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:36.215893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cc161338-1b09-4a80-b93f-66ab4bdb69f1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.204136 Sep 22 12:37:36.216522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 476/965] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:36 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:37.244919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:37.245589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:37.253204 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:37.258584 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:37.258872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:37.259721 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:37.260180 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:37.260649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:37.433685 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:37.444242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0d21a1b0-fef7-46f3-ab3c-cfb24e417b64 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.206261 Sep 22 12:37:37.444581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 490/966] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:37 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:38.467482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:38.468195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:38.473226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:38.473965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=10 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:38.478877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:38.479760 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:38.480366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:38.481162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:38.481751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:38.482246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:38.531618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:38.541880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:38.548843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:38.551498 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:38.552273 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:38.564939 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] Creating event network-changed:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:37:38.570129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-7c2c39a7-35ca-4881-a3e9-973fc0da5e4b req-f65b821c-02cb-446e-aee7-985c56e626eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042292 Sep 22 12:37:38.570938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 491/967] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:38.756285 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:38.764201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-290e8ce1-1263-4885-b63d-8f7f58a0c2c0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.300638 Sep 22 12:37:38.764783 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 477/968] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:38 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:39.789933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:39.790555 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:39.796967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:39.797439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:39.797894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:39.798727 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:39.799176 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:39.799593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:40.020937 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:40.029961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-edde1392-6d75-4cad-9e4d-947f2a070475 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.244711 Sep 22 12:37:40.030806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 492/969] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:39 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:41.053586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:41.054199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:41.060733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:41.061219 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:41.061687 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:41.062372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:41.062829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:41.063250 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:41.189522 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:41.197729 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e7e5bde2-8e08-400e-95a2-0d7620c7f4fb tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.148517 Sep 22 12:37:41.198286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 478/970] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:41 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:42.222079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:42.222079 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:42.234549 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:42.235174 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:42.235624 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:42.236385 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:42.236847 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:42.237276 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:42.369675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:42.377232 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-fe0c885d-421a-4dd9-a2b1-ec83c394cb91 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.159959 Sep 22 12:37:42.377794 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 493/971] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:42 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:43.400073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:43.400744 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:43.407203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:43.407684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:43.408119 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:43.408834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:43.409287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:43.409715 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:43.533609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:43.541188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2a6561f5-030e-43e3-876c-0ec829ac9792 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.144942 Sep 22 12:37:43.541743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 479/972] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:43 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:44.565343 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:44.566737 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:44.578735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:44.579565 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:44.580226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:44.581315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:44.583060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:44.583690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:44.588059 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "name": "network-vif-plugged", "status": "completed", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:44.605291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:44.606155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:44.606863 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:44.621533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] Creating event network-vif-plugged:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:37:44.627533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c43fc6fe-386c-4006-af26-16784d332f44 req-9e04cd62-8c09-4306-b890-2a0eb3ef7790 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048557 Sep 22 12:37:44.629602 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 480/973] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:44.743427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:44.752988 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b370da5c-6bfc-49ff-a445-ec7c86ad4be3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.192461 Sep 22 12:37:44.754429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 494/974] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:44 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:45.778584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:45.779280 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:45.786609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:45.787086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:45.787519 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:45.788197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:45.788666 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:45.789086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:45.922282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:45.929846 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b23b544-c7a8-4306-b568-7967b57deb3c tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1359 microversion: 2.1 time: 0.155503 Sep 22 12:37:45.930402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 481/975] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:45 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:46.952750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:46.953356 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:46.960664 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:46.961098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:46.961774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:46.962457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:46.962900 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:46.963341 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.122198 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:47.130030 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-1a6c17a7-8310-4555-b1f0-0e9136d466a0 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1548 microversion: 2.1 time: 0.181147 Sep 22 12:37:47.130598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 495/976] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:46 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:37:47.155161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:47.155817 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:47.163722 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.164266 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.164785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.165489 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.165942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.166369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.297970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:47.306028 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d5037ef8-daa4-43b5-9f66-7fe63128ffce tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1548 microversion: 2.1 time: 0.155384 Sep 22 12:37:47.306603 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 482/977] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:47 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:47.328575 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:47.333955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:47.334712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Searching by: {'deleted': False, 'project_id': '4793b91c7212484c84960201b2d39114'} {{(pid=120604) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 22 12:37:47.341319 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.341792 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.342224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.342945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.343393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.343842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.434636 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.multi_cell_list [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120604) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 22 12:37:47.531776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-89eb753a-6971-4843-ab71-7ccf885b3d11 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206814 Sep 22 12:37:47.532380 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 496/978] 10.222.0.33 () {58 vars in 1125 bytes} [Thu Sep 22 12:37:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:47.543834 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:47.544566 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:47.550546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.550969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.551408 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.552103 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:47.552578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:47.553002 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:47.680406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:47.688126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d17b6c83-f94c-49a1-ad4f-b60677af21a9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1548 microversion: 2.1 time: 0.148122 Sep 22 12:37:47.688710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 483/979] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:47 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:37:49.272846 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "272ba7bd-7374-4808-a426-3edfc37661f4"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:49.275405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:49.282558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:49.283048 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:49.283490 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:49.284188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:49.284674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:49.285106 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:49.416561 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:49.534733 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a256db6a-aa9c-4172-bdc0-3df856ca486a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265738 Sep 22 12:37:49.535393 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 497/980] 10.222.0.33 () {60 vars in 1323 bytes} [Thu Sep 22 12:37:49 2022] POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:56.092686 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:56.093301 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:56.095479 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:56.100950 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:56.101436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:56.101871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:56.102810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:56.103276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:56.103700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:56.108428 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=91 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:56.240868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:37:56.249042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f0c487df-b6ad-45dd-ace1-324ec95e2cea tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1594 microversion: 2.1 time: 0.160347 Sep 22 12:37:56.249777 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 484/981] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:56 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:37:58.207084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:58.215360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:58.216156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:37:58.220785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:58.221309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:58.221882 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:58.236842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] Creating event network-changed:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:37:58.242752 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-4304756e-f56e-4fb6-a7ab-c5d8a1c38c3c req-2cb66ff3-7b84-4013-9ca2-3775417cbb3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Sep 22 12:37:58.243572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 498/982] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:37:59.375433 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-695521340"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:37:59.375966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:59.382488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:59.382979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:59.383416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:59.384112 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:59.384779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:59.385210 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:59.516443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Adding security group c00f8a4b-551c-42ca-9059-e7181e649e4b to port da2472cb-1cbb-4ba4-a05d-ce245112de62 Sep 22 12:37:59.822294 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ea7eb614-3126-43d3-95a4-d9c7d43cdea6 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action" status: 202 len: 0 microversion: 2.1 time: 0.450774 Sep 22 12:37:59.822918 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 485/983] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:37:59 2022] POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:37:59.832175 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:37:59.833510 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:37:59.841363 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:59.841863 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:59.842291 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:37:59.843394 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:37:59.843857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:37:59.844288 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:00.011097 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:00.019251 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c287c30b-b79e-4407-a567-2af95de3877a tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1759 microversion: 2.1 time: 0.191582 Sep 22 12:38:00.020327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 499/984] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:37:59 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:00.256909 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:00.266139 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:00.266610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:00.267040 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:00.278620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] Creating event network-changed:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:38:00.283650 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-2721f302-0797-4177-87a3-0f05de7418c1 req-8d4d5531-cd29-4422-bd7e-139147429c29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030941 Sep 22 12:38:00.284227 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 486/985] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:38:18.630476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:18.631039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:18.634345 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:18.635183 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:18.640631 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:18.641108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:18.641538 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:18.642221 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:18.642666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:18.643085 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:18.668463 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:38:18.742392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-edea0e9f-a97c-4d5f-8681-9628730fefde tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 204 len: 0 microversion: 2.1 time: 0.114885 Sep 22 12:38:18.742962 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 500/986] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:38:18 2022] DELETE /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 22 12:38:18.749043 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=5 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:18.749831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=11 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:18.753831 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:18.754528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:18.761510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:18.761988 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:18.762419 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:18.763104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:18.763554 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:18.763973 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:18.902811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:18.910693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a672b2f-1589-4a31-8a20-b0da737a228c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1577 microversion: 2.1 time: 0.163355 Sep 22 12:38:18.911255 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 487/987] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:18 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:19.935248 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:19.935950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:19.942326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:19.942799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:19.943227 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:19.943936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:19.944403 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:19.945433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:20.075028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:20.082712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-75499750-78af-4c98-8dd3-de03d6bf202f tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1577 microversion: 2.1 time: 0.151723 Sep 22 12:38:20.083268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 501/988] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:19 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:21.105369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:21.106007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:21.112759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:21.113252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:21.113694 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:21.114403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:21.114862 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:21.115292 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:21.321952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:21.329691 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ad28aae-c836-4ade-88c5-77a12b407ed5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1577 microversion: 2.1 time: 0.228565 Sep 22 12:38:21.330259 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 488/989] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:21 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:21.707582 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca03754-f373-43f1-b251-20165efd6733", "name": "network-vif-deleted", "tag": "48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:21.729026 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:21.729500 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:21.729920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:21.744285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] Creating event network-vif-deleted:48b3f0a4-96d3-46e3-a20a-0e6e5571bb8f for instance cca03754-f373-43f1-b251-20165efd6733 on hv-cinder-85646 Sep 22 12:38:21.749260 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-279d1ffb-57dd-477a-b65d-cce454b609ea req-f824f2c1-00f8-4947-8b56-246f7c149f00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045727 Sep 22 12:38:21.749842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 502/990] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:38:22.354761 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:22.355504 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:22.361600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:22.362085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:22.362515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:22.363216 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:22.363650 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:22.364067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:22.394222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:22.394992 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:22.396218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:22.396684 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lazy-loading 'fault' on Instance uuid cca03754-f373-43f1-b251-20165efd6733 {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:38:22.445499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:22.455106 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e3df2716-638e-400d-93bb-519eb1964fcb tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 200 len: 1231 microversion: 2.1 time: 0.104895 Sep 22 12:38:22.455764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 489/991] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:22 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:23.481392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:23.482077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:23.488110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.488618 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.489047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:23.489721 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.490162 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.490577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:23.503256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] HTTP exception thrown: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Request method failure captured: Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 HTTP/1.1 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFaVNFGgTQv6QrQ3m94-i1TjWfb8ikdyrlbYKUHyVbU-ZuBnsjpfstew-GedK03WzIMBLrAc1NEEX4gMhbS--vm6YAcremJJnAYPkdEcKfbqqxC8C9sCVq8X_BQLL-NLl6wFONGVdk77OUjQkBG3jPBdyCoezHjLn_IzY___rPZGydE Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:38:23.504867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d44fc4fa85a4dfb82c31a602037a249"}]}] Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: f42af00458ac4046888a73397218f9f5 Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:38:23.506566 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'cca03754-f373-43f1-b251-20165efd6733'} Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:38:23.508061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:38:23.509773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:38:23.511217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Returning 404 to user: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:38:23.511217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3f7e944c-0c1b-45a8-a296-4f7a7e21a34c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 404 len: 111 microversion: 2.1 time: 0.029741 Sep 22 12:38:23.511217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 503/992] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:23 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:38:23.600388 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-76417844", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194840390", "security_groups": [{"name": "tempest-secgroup-smoke-358311579"}], "block_device_mapping_v2": [{"uuid": "79063296-0c17-45c4-b567-158a25bdadd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1ec96ed-6bf3-486f-b981-c8837f8cbc07"}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:23.693111 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:23.695938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:23.702044 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.702523 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.702950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:23.703806 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.704428 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.704850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:23.725049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] validate_networks() for [('a1ec96ed-6bf3-486f-b981-c8837f8cbc07', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:38:23.781330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ec695eb3-f91b-4d43-811d-bae01ba9e961 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action" status: 202 len: 0 microversion: 2.1 time: 0.091658 Sep 22 12:38:23.785015 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 504/993] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:38:23 2022] POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 22 12:38:23.790529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:23.791219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:23.797617 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.798140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.798577 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:23.799459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:23.799936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:23.800429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:24.142723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:24.151123 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-6f0afa39-3a15-41e5-badf-e8610e261549 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1751 microversion: 2.1 time: 0.364685 Sep 22 12:38:24.151684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 505/994] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:23 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1751 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:24.372047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:38:24.372724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:38:24.373200 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:38:24.373610 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:38:24.374017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:38:24.383278 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:24.383749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:24.384183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:24.384930 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:24.385382 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:24.385803 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:24.403708 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:38:24.407794 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for user f42af00458ac4046888a73397218f9f5 and project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:38:24.465966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:38:24.468080 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='79063296-0c17-45c4-b567-158a25bdadd0',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:38:24.607352 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f97d08c8-f586-449c-aeca-9ce5e77e7b02 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010805 Sep 22 12:38:24.611204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 490/995] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:38:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:38:24.619064 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-145b4a67-7640-45c8-9cfd-20f5bd230d15 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:24.620456 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-145b4a67-7640-45c8-9cfd-20f5bd230d15 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:24.678153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-145b4a67-7640-45c8-9cfd-20f5bd230d15 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:24.685505 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-145b4a67-7640-45c8-9cfd-20f5bd230d15 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1093 microversion: 2.1 time: 0.070341 Sep 22 12:38:24.686066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 506/996] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:24 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:25.175688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:25.176226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:25.183655 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:25.184155 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:25.184733 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:25.185428 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:25.186236 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:25.186990 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:25.328209 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:25.336872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2b6f8daa-2d47-46ee-88dc-542e388f0990 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.166078 Sep 22 12:38:25.337431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 491/997] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:25 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:25.708935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d3ee606d-3cbc-4865-b0fd-76248d4cc3ab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:25.709581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d3ee606d-3cbc-4865-b0fd-76248d4cc3ab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:25.761874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d3ee606d-3cbc-4865-b0fd-76248d4cc3ab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:25.768581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d3ee606d-3cbc-4865-b0fd-76248d4cc3ab tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1093 microversion: 2.1 time: 0.063518 Sep 22 12:38:25.769132 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 507/998] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:25 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:26.360903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:26.361532 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:26.369196 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:26.369779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:26.370205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:26.371056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:26.371573 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:26.372001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:26.512851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:26.521172 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7ad9639e-79fd-46c6-a9c3-415b73532a97 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.165614 Sep 22 12:38:26.530969 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 492/999] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:26 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:26.791953 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:26.792516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:26.798889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:26.799374 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:26.799818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:26.800540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:26.801000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:26.801423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:26.865228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:26.873000 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-80a8bb9b-622f-4fe6-89f3-8063f52d2b85 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1143 microversion: 2.1 time: 0.085508 Sep 22 12:38:26.873562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 508/1000] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:26 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:27.546372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:27.547017 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:27.554443 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:27.554947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:27.555387 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:27.556710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:27.557178 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:27.557802 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:27.882766 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:27.894950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:27.895731 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:27.901949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:27.902419 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:27.902850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:27.903552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:27.903998 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:27.904439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:27.911333 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-126c9939-09d0-4131-b48e-5b5218b8082f tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.370336 Sep 22 12:38:27.911916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 493/1001] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:27 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:27.995025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:28.003581 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-b4239d9a-8e30-4f4e-bb99-3a08f972c68a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1209 microversion: 2.1 time: 0.112487 Sep 22 12:38:28.004433 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 509/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:27 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:28.935600 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:28.936326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:28.942798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:28.943282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:28.943829 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:28.945016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:28.945472 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:28.945897 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:29.027314 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:29.028062 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:29.034662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:29.035225 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:29.035857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:29.036590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:29.037051 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:29.037481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:29.265369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:29.274369 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-6a048d0d-d450-41d3-b0e5-9efd26d0cc16 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.342705 Sep 22 12:38:29.274944 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 494/1003] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:28 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:29.293652 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:29.303021 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-46bdb045-9a91-4975-82b1-7a38d9877346 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.279553 Sep 22 12:38:29.316683 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 510/1004] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:29 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:29.434872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f899b259-9171-48fc-956e-1b7185432312", "tag": "862c2f78-8a44-46e8-a88c-6091a58bc3eb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:29.444838 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:29.445310 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:29.445738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:29.459943 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] Creating event network-changed:862c2f78-8a44-46e8-a88c-6091a58bc3eb for instance f899b259-9171-48fc-956e-1b7185432312 on hv-cinder-85646 Sep 22 12:38:29.464826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-396d6885-bb75-4d3e-980d-b926c3dea108 req-87a0b425-77d0-48b3-83af-97b1fcbd92b7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 Sep 22 12:38:29.465567 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 495/1005] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:38:30.298136 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:30.298767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:30.305470 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:30.305955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:30.306384 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:30.307099 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:30.307536 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:30.307950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:30.328716 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:30.329604 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:30.337359 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:30.337851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:30.338287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:30.338989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:30.339469 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:30.340097 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:30.773348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:30.778677 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:30.781649 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-55b2c12a-8e29-43cd-8626-9d1189a95b46 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.487411 Sep 22 12:38:30.782213 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 511/1006] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:30 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:30.789707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8f694c40-6aac-4568-b2b9-3c12edb8935b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.466249 Sep 22 12:38:30.790424 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 496/1007] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:30 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:31.805468 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:31.806093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:31.812153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:31.812515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:31.812935 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:31.813130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:31.813237 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:31.813829 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:31.814274 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:31.814698 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:31.819938 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:31.820445 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:31.820876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:31.821570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:31.822022 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:31.822444 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:32.023835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:32.029161 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:32.031622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c6048747-98df-47ea-ac83-7caf3a95ad6e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.222963 Sep 22 12:38:32.032416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 497/1008] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:31 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:32.037449 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-49af7b15-16f3-408e-a414-5b22a6e7f145 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.235971 Sep 22 12:38:32.039779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 512/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:31 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:33.053404 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:33.057395 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:33.061331 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:33.061821 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:33.062257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:33.062952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:33.063371 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:33.063782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:33.063782 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:33.063967 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:33.070327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:33.070803 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:33.071230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:33.071917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:33.072390 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:33.072810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:33.261668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:33.269540 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1ff8f64c-ef10-418a-ba3c-da220470befd tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.220008 Sep 22 12:38:33.270120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 498/1010] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:33 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:33.278408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:33.286638 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c58314f1-3363-4e98-8b49-036be3ffdc98 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.227133 Sep 22 12:38:33.287193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 513/1011] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:33 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:34.292020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:34.292659 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:34.299031 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:34.299512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:34.299945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:34.300668 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:34.301120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:34.301545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:34.310011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:34.310620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:34.317060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:34.317644 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:34.318083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:34.318772 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:34.319919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:34.320377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:34.393067 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:34.415057 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:34.497781 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:34.505563 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95550d86-ea25-41e8-91c2-08401f7cee73 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.217449 Sep 22 12:38:34.506132 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 499/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:34 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:34.518874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:34.527532 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-151b89f6-7ded-43da-8753-03106b8aabf3 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.221326 Sep 22 12:38:34.528323 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 514/1013] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:34 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:35.529627 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:35.530248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:35.536773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:35.537261 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:35.537732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:35.538916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:35.539371 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:35.539800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:35.555769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:35.556381 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:35.562679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:35.563150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:35.563573 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:35.564286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:35.564758 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:35.565168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:35.736769 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:35.744360 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f2035bd7-856d-4cdb-bc8b-6ca9befcf09e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.218705 Sep 22 12:38:35.744924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 500/1014] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:35 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:35.757098 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:35.765397 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-c296a45f-30bf-4a1f-9e09-32d75c9fe075 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1756 microversion: 2.1 time: 0.214172 Sep 22 12:38:35.765951 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 515/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:35 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:36.766465 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:36.767076 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:36.773513 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:36.773985 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:36.774410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:36.775086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:36.775533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:36.775951 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:36.787934 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:36.788650 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:36.792311 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:36.796868 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:36.797353 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:36.797780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:36.798481 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:36.798936 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:36.799360 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:36.969146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:36.977320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-eab8b828-7ac4-42a8-aa75-7968b6bf550b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.214715 Sep 22 12:38:36.978137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 501/1016] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:36 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:36.994839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:37.003209 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4a3a2bf9-3e2b-4662-9299-873192fdcbc9 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1759 microversion: 2.1 time: 0.219008 Sep 22 12:38:37.003714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 516/1017] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:36 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1759 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:38.001071 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:38.001778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:38.008436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:38.008914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:38.009337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:38.010682 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:38.011127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:38.011544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:38.141549 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:38.149406 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-04b117ef-9bdc-4647-adaa-4186727e4df0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.152159 Sep 22 12:38:38.150056 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 502/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:37 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:39.172033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:39.172635 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:39.179441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:39.180892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:39.180892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:39.180892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:39.181228 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:39.181537 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:39.185561 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:39.319038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:39.327502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a2c06e99-d998-4075-9a1b-3dcae71350aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.159413 Sep 22 12:38:39.328061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 517/1019] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:39 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:40.290069 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f899b259-9171-48fc-956e-1b7185432312", "name": "network-vif-plugged", "status": "completed", "tag": "862c2f78-8a44-46e8-a88c-6091a58bc3eb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:40.301656 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:40.302140 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:40.302556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:40.313778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] Creating event network-vif-plugged:862c2f78-8a44-46e8-a88c-6091a58bc3eb for instance f899b259-9171-48fc-956e-1b7185432312 on hv-cinder-85646 Sep 22 12:38:40.318765 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-031f6fd7-8c9f-4beb-8f92-333c5657bb30 req-4d8add7b-a231-4416-8279-8d15ad8c4fba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032978 Sep 22 12:38:40.319345 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 503/1020] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:38:40.349982 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:40.350874 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:40.359464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:40.360016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:40.360392 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:40.361257 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:40.361708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:40.362131 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:40.496007 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:40.503987 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-38b351fc-530c-4b89-ab80-903983e8e9da tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.158032 Sep 22 12:38:40.504602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 518/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:40 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:41.528804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:41.529502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:41.535653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:41.536137 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:41.536605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:41.537297 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:41.537751 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:41.538169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:41.670680 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:41.678358 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7e4d04e0-735b-4bd9-88e2-51172ce586ef tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1264 microversion: 2.1 time: 0.154812 Sep 22 12:38:41.678913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 504/1022] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:41 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:42.700773 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:42.701429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:42.707963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:42.708475 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:42.708909 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:42.709736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:42.710188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:42.710607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:42.836639 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:42.844222 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f168e24b-33c6-4067-8e1d-eaa36ffe7761 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1451 microversion: 2.1 time: 0.147387 Sep 22 12:38:42.844807 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 519/1023] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:42 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:38:42.866552 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:38:42.867162 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:38:42.874865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:42.874865 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:42.875247 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:42.875946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:42.876421 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:42.876845 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:42.880872 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=100 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:38:43.007258 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:38:43.015020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e8a887f5-97b0-4a78-8716-4a7bf7737977 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1451 microversion: 2.1 time: 0.152318 Sep 22 12:38:43.015578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 505/1024] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:38:42 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:38:44.552043 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f899b259-9171-48fc-956e-1b7185432312", "tag": "862c2f78-8a44-46e8-a88c-6091a58bc3eb"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:38:44.561876 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:38:44.562352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:38:44.562782 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:38:44.574019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] Creating event network-changed:862c2f78-8a44-46e8-a88c-6091a58bc3eb for instance f899b259-9171-48fc-956e-1b7185432312 on hv-cinder-85646 Sep 22 12:38:44.578930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-34b5b75b-9b28-4e98-9cc7-f7226faa23fa req-1ef51a77-6f0c-4d68-8bcd-29f25ccdd248 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030602 Sep 22 12:38:44.579516 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 520/1025] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:39:10.627742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-695521340"}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:10.628341 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:10.630544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:10.631191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=4 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:10.638388 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:10.638947 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:10.639376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:10.640066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:10.640541 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:10.640960 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:10.769050 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.network.security_group_api [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Removing security group c00f8a4b-551c-42ca-9059-e7181e649e4b from port da2472cb-1cbb-4ba4-a05d-ce245112de62 Sep 22 12:39:11.069146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-68ea0b47-84d8-487d-8be1-bbb9dcd86055 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action" status: 202 len: 0 microversion: 2.1 time: 0.445178 Sep 22 12:39:11.070129 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 506/1026] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:39:10 2022] POST /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:39:11.075779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:11.076684 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=18 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:11.080774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:11.117526 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:11.119070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:11.119070 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:11.138130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] Creating event network-changed:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:39:11.145688 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-7f6d0e7c-bce7-46b4-8b67-59a2616113b2 req-6c9aecf8-3274-4c45-a090-43e96b6e503a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071245 Sep 22 12:39:11.146556 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 521/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:39:12.120648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:12.121743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:12.124473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:12.127854 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:12.128374 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:12.128999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:12.129867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:12.130772 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:12.131410 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:12.135551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:12.136237 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:12.136926 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:12.148460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] Creating event network-changed:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:39:12.153805 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-89306a26-1d01-4129-9949-c8773c4a464b req-8e740099-e946-42fa-b977-99ec5147ccbc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033261 Sep 22 12:39:12.155183 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 522/1028] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:39:12.217702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.objects.instance [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lazy-loading 'services' on Instance uuid 3d05490e-4480-4ff7-9fe4-be7c63c1df9a {{(pid=120603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:39:12.300355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5e67b3f1-2ac2-458c-afb2-00940b59da58 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments/272ba7bd-7374-4808-a426-3edfc37661f4" status: 202 len: 0 microversion: 2.1 time: 0.184160 Sep 22 12:39:12.311749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:12.314275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:12.315495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 507/1029] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:39:12 2022] DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments/272ba7bd-7374-4808-a426-3edfc37661f4 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:39:12.323246 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:12.323825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:12.324359 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:12.325331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:12.325732 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:12.326338 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:12.359253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-092007ee-10b9-4af3-b152-f39d3c6cedf8 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053381 Sep 22 12:39:12.359825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 523/1030] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:39:12 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:39:13.373482 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:13.375836 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:13.382087 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:13.382572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:13.383001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:13.384431 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:13.384881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:13.385300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:13.413584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9b6106d7-13a9-4b9c-84cd-5b1a0a2dab37 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045296 Sep 22 12:39:13.414049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 508/1031] 10.222.0.33 () {58 vars in 1302 bytes} [Thu Sep 22 12:39:13 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 22 12:39:13.425521 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:13.426084 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:13.433258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:13.433735 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:13.434271 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:13.434903 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:13.435346 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:13.435761 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:13.729096 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] HTTP exception thrown: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a is not attached to volume 272ba7bd-7374-4808-a426-3edfc37661f4 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Request method failure captured: Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments/272ba7bd-7374-4808-a426-3edfc37661f4 HTTP/1.1 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFb3oczGZX-e9kbnOyim8VAk5SxJD070vdH-JX3XBbON9gBe-R6183K5zsulSNQ9B054Ij3ROztRAMyPIaYjR-TdN5nK0y_yGpveVCvYEDa1vZOsY4zZZPm7N8KC-ZGWT0EQNCcEhjHIVB2jmjbmowN5EP3-GUHuOGfQW3pJqx-McoU Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 4793b91c7212484c84960201b2d39114 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:39:13.731388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4793b91c7212484c84960201b2d39114"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4793b91c7212484c84960201b2d39114"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4793b91c7212484c84960201b2d39114"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4793b91c7212484c84960201b2d39114"}]}] Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 4793b91c7212484c84960201b2d39114 Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestMinimumBasicScenario-1854800535-project Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 1c6957aac61b4ed985e2dafc888c4b6a Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestMinimumBasicScenario-1854800535-project Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:39:13.733193 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a is not attached to volume 272ba7bd-7374-4808-a426-3edfc37661f4 Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'server_id': '3d05490e-4480-4ff7-9fe4-be7c63c1df9a', 'id': '272ba7bd-7374-4808-a426-3edfc37661f4'} Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 272ba7bd-7374-4808-a426-3edfc37661f4. Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:39:13.734330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a is not attached to volume 272ba7bd-7374-4808-a426-3edfc37661f4 Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a is not attached to volume 272ba7bd-7374-4808-a426-3edfc37661f4 Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:13.735884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Returning 404 to user: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a is not attached to volume 272ba7bd-7374-4808-a426-3edfc37661f4 {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:39:13.737182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cf338fdb-e350-44bc-8113-f57baba3d152 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments/272ba7bd-7374-4808-a426-3edfc37661f4" status: 404 len: 154 microversion: 2.1 time: 0.311276 Sep 22 12:39:13.737182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 524/1032] 10.222.0.33 () {58 vars in 1416 bytes} [Thu Sep 22 12:39:13 2022] DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a/os-volume_attachments/272ba7bd-7374-4808-a426-3edfc37661f4 => generated 154 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:39:14.869791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:14.870279 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:14.876871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:14.877379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:14.877851 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:14.878545 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:14.878994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:14.879417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:14.906073 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:39:14.979553 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-60107457-dd79-401f-8d8c-303173f7de90 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 204 len: 0 microversion: 2.1 time: 0.113949 Sep 22 12:39:14.980042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 509/1033] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:39:14 2022] DELETE /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:39:14.989280 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:14.990485 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:14.998983 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:14.999460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:14.999884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:15.000592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:15.001066 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:15.001490 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:15.129920 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:15.137563 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e664d420-eb9b-49ea-9fed-011e1d1277a1 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1554 microversion: 2.1 time: 0.153135 Sep 22 12:39:15.138108 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 525/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:14 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:16.160703 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:16.161312 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:16.168246 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:16.168756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:16.169192 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:16.169875 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:16.170326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:16.170748 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:16.395030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:16.403228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2ef82f77-3d72-4b6b-aec0-6eaf57fd9441 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1554 microversion: 2.1 time: 0.246906 Sep 22 12:39:16.403778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 510/1035] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:16 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:17.422734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d05490e-4480-4ff7-9fe4-be7c63c1df9a", "name": "network-vif-deleted", "tag": "da2472cb-1cbb-4ba4-a05d-ce245112de62"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:17.426843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:17.427720 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:17.434520 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:17.435006 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:17.435440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:17.449035 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] Creating event network-vif-deleted:da2472cb-1cbb-4ba4-a05d-ce245112de62 for instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a on hv-cinder-85646 Sep 22 12:39:17.450269 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:17.450796 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:17.451518 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:17.452320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:17.452787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:17.453214 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:17.454614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-d7f4b3f6-f2a4-41e3-ab3e-9eedf6bb3aea req-4f5acd12-8d35-4709-b4f4-92803c4abef0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035538 Sep 22 12:39:17.455407 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 526/1036] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:39:17.518785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6957aac61b4ed985e2dafc888c4b6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4793b91c7212484c84960201b2d39114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:17.527058 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-dde7a21f-7f00-42a7-8d53-183b4a3a3dae tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 200 len: 1344 microversion: 2.1 time: 0.104945 Sep 22 12:39:17.527661 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 511/1037] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:17 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 1344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:39:18.551873 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:18.552608 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] [instance: 3d05490e-4480-4ff7-9fe4-be7c63c1df9a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:18.559436 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:18.559856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:18.560286 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:18.560986 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:18.561431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:18.561848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:18.575607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] HTTP exception thrown: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Request method failure captured: Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a HTTP/1.1 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFb3oczGZX-e9kbnOyim8VAk5SxJD070vdH-JX3XBbON9gBe-R6183K5zsulSNQ9B054Ij3ROztRAMyPIaYjR-TdN5nK0y_yGpveVCvYEDa1vZOsY4zZZPm7N8KC-ZGWT0EQNCcEhjHIVB2jmjbmowN5EP3-GUHuOGfQW3pJqx-McoU Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 4793b91c7212484c84960201b2d39114 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:39:18.577461 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4793b91c7212484c84960201b2d39114"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4793b91c7212484c84960201b2d39114"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4793b91c7212484c84960201b2d39114"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4793b91c7212484c84960201b2d39114"}]}] Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 4793b91c7212484c84960201b2d39114 Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1854800535 Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestMinimumBasicScenario-1854800535-project Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 1c6957aac61b4ed985e2dafc888c4b6a Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestMinimumBasicScenario-1854800535-project Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. Sep 22 12:39:18.579109 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '3d05490e-4480-4ff7-9fe4-be7c63c1df9a'} Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:39:18.580032 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. Sep 22 12:39:18.581588 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:39:18.582945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Returning 404 to user: Instance 3d05490e-4480-4ff7-9fe4-be7c63c1df9a could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:39:18.582945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71d8e0a1-10ef-40a0-9ca7-ab80e5ef00ba tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a" status: 404 len: 111 microversion: 2.1 time: 0.031582 Sep 22 12:39:18.582945 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 527/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:18 2022] GET /compute/v2.1/servers/3d05490e-4480-4ff7-9fe4-be7c63c1df9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:39:18.587818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-af0bde02-3df1-4106-a890-06302175b5e7 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] Calling method '.version_select at 0x7f1079a87670>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:18.606165 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-af0bde02-3df1-4106-a890-06302175b5e7 tempest-TestMinimumBasicScenario-1854800535 tempest-TestMinimumBasicScenario-1854800535-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1510588056" status: 202 len: 0 microversion: 2.1 time: 0.022136 Sep 22 12:39:18.606695 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 512/1039] 10.222.0.33 () {58 vars in 1272 bytes} [Thu Sep 22 12:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1510588056 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:39:36.064164 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=14 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:36.065110 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=26 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:36.248405 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8ad9971b-14ea-453c-afef-fc8441e3cc90 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Action: 'create', calling method: .version_select at 0x7f1079d585e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1847061826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4Qa1zR1oqN+QKiyg0lnJal14KveQp7cpjdUftZHiFV5q+RZOHyXcQUOBdjw9/QaeRDM5Oo42XVW6iKyl3TFNwWMSZHArDJbDNceu4J3FKn5EYboQzZrTJKVNB+WhABHQ=="}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:36.265869 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-8ad9971b-14ea-453c-afef-fc8441e3cc90 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Getting quotas for project f4d530e1b20c47319f5e8949d808c1b3. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:39:36.270035 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-8ad9971b-14ea-453c-afef-fc8441e3cc90 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Getting quotas for user 7b3e6035de1e4fe3a651ece7d82842eb and project f4d530e1b20c47319f5e8949d808c1b3. Resources: {'key_pairs'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:39:36.295052 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8ad9971b-14ea-453c-afef-fc8441e3cc90 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.236519 Sep 22 12:39:36.295646 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 528/1040] 10.222.0.33 () {60 vars in 1159 bytes} [Thu Sep 22 12:39:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:39:52.613075 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:52.613826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:52.617826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1264773845", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1847061826", "security_groups": [{"name": "tempest-secgroup-smoke-216351991"}], "networks": [{"uuid": "fa4c16fb-2b69-4afc-a780-323b3230115f"}], "block_device_mapping_v2": [{"uuid": "579f112e-790a-4e5e-8330-fc940398c356", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:52.730649 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.network.neutron [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] validate_networks() for [('fa4c16fb-2b69-4afc-a780-323b3230115f', None, None, None, None, None)] {{(pid=120603) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:39:53.193675 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Flavor limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:39:53.194127 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Image limits 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:39:53.194606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Flavor pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:39:53.195014 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Image pref 0:0:0 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:39:53.195427 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.virt.hardware [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:39:53.204092 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:53.204606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:53.205041 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:53.205764 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:53.206212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:53.206634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:53.223244 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Getting quotas for project f4d530e1b20c47319f5e8949d808c1b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:39:53.227446 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.quota [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Getting quotas for user 7b3e6035de1e4fe3a651ece7d82842eb and project f4d530e1b20c47319f5e8949d808c1b3. Resources: {'ram', 'cores', 'instances'} {{(pid=120603) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:39:53.287502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Going to run 1 instances... {{(pid=120603) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:39:53.289679 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='579f112e-790a-4e5e-8330-fc940398c356',volume_size=None,volume_type=None)] {{(pid=120603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:39:53.416878 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ddee9c49-75cb-438f-be40-2ba245cce4a2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805606 Sep 22 12:39:53.417529 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 513/1041] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:39:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:39:53.425950 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=4 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:53.426826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:39:53.430616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a937f9c8-f1e6-4ea3-b76c-b81bd56dd04b tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:53.431224 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a937f9c8-f1e6-4ea3-b76c-b81bd56dd04b tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:53.488562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-a937f9c8-f1e6-4ea3-b76c-b81bd56dd04b tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:53.496534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a937f9c8-f1e6-4ea3-b76c-b81bd56dd04b tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1089 microversion: 2.1 time: 0.071877 Sep 22 12:39:53.497117 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 529/1042] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:53 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:54.518743 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:54.519276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:54.525779 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:54.526268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:54.526706 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:54.527403 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:54.527859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:54.528357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:54.594390 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:54.602503 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-d89cdcf0-b1c8-4829-874c-a56c5384ce5a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1187 microversion: 2.1 time: 0.087392 Sep 22 12:39:54.603326 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 514/1043] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:54 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:55.625825 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:55.626457 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:55.632930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:55.633420 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:55.633857 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:55.634558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:55.635014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:55.635440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:55.835872 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:55.844729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-9787c353-9e17-42ed-9e60-7fd5546c5898 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.222704 Sep 22 12:39:55.845597 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 530/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:55 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:56.212325 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:39:56.221742 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:56.222217 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:56.222670 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:56.234640 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] Creating event network-changed:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:39:56.239488 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-ffe007d1-2667-431d-8599-eb9d9e213278 req-a57c965f-6ab1-4e1f-b15e-2464f092344e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093400 Sep 22 12:39:56.240079 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 515/1045] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:39:56.867077 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:56.867690 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:56.874917 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:56.875402 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:56.875888 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:56.876632 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:56.877080 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:56.877506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:57.076612 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:57.084779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4c15c111-c320-42a9-8fa6-8db54154c332 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.221426 Sep 22 12:39:57.085459 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 531/1046] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:56 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:58.107632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:58.108354 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:58.114475 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:58.114959 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:58.115402 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:58.116089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:58.116576 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:58.117000 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:58.252746 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:58.260355 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-94da499e-9706-4ebe-9e09-fdcdf72d7eba tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.157467 Sep 22 12:39:58.260910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 516/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:58 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:39:59.284127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:39:59.284716 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:39:59.291185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:59.291657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:59.292087 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:59.292793 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:39:59.293241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:39:59.293657 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:39:59.421218 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:39:59.428843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d1728009-d7fa-41d1-aff9-66370eb723b1 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.148799 Sep 22 12:39:59.429398 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 532/1048] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:39:59 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:00.450147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:00.450759 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:00.457824 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:00.458302 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:00.458734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:00.459416 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:00.459892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:00.460335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:00.592018 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:00.599650 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-93b1f4ed-9a20-4c57-ba0d-914b2724e6cc tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.153339 Sep 22 12:40:00.600205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 517/1049] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:00 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:01.622491 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:01.623102 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:01.629297 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:01.629777 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:01.630210 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:01.630896 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:01.631349 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:01.631775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:01.761312 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:01.769496 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d6c45882-1ab4-4822-b89d-e0418f02ab64 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.150931 Sep 22 12:40:01.770055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 533/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:01 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:02.792609 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:02.793248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:02.799877 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:02.800386 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:02.800818 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:02.801495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:02.801940 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:02.802356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:02.938226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:02.945862 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-215ab2a8-7951-4ae1-9bf8-51372a810054 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.157160 Sep 22 12:40:02.946413 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 518/1051] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:02 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:03.969614 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:03.970226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:03.972572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:03.978083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:03.978553 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:03.978980 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:03.979662 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:03.980107 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:03.980564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:04.109587 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:04.117156 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ec4cf84c-c998-474d-b2ef-4c8b2a6f96de tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.152044 Sep 22 12:40:04.117942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 534/1052] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:03 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:05.139051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:05.139628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:05.141533 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:05.142212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=6 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:05.148605 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:05.149064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:05.149502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:05.150199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:05.150711 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:05.151169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:05.279825 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:05.287922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9f87c860-d742-482a-ae94-d554def98d28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.152820 Sep 22 12:40:05.288503 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 519/1053] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:05 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:06.310833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:06.311447 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:06.318550 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:06.319024 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:06.319453 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:06.320139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:06.320619 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:06.321041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:06.450231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:06.457907 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5d571609-1fc5-419e-855c-3d0f8cb86631 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.150871 Sep 22 12:40:06.458399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 535/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:06 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:06.784508 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "name": "network-vif-plugged", "status": "completed", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:06.794303 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:06.794780 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:06.795212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:06.806490 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] Creating event network-vif-plugged:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:40:06.811363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-c9fa4b44-7b3b-4c0b-8095-93c656364dcd req-7725cf11-6254-4a3f-8487-fcb6c39c5013 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086603 Sep 22 12:40:06.811926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 520/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:40:07.480203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:07.480835 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:07.488188 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:07.488693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:07.489121 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:07.489804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:07.490250 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:07.490668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:07.618830 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:07.626477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-050c82a5-828d-4908-b306-78e9b03d8293 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1260 microversion: 2.1 time: 0.150432 Sep 22 12:40:07.627034 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 536/1056] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:07 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:08.650596 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:08.651648 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:08.658843 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:08.659332 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:08.659768 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:08.660502 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:08.660955 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:08.661381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:08.798702 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:08.806535 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-43f406f3-a2ba-40c0-9c8a-b5d139d0e0cb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1444 microversion: 2.1 time: 0.160793 Sep 22 12:40:08.807089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 521/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:08 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:08.829115 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:08.829776 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:08.836093 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:08.836616 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:08.837055 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:08.837746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:08.838203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:08.838628 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:08.967396 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:08.975160 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-06f7a33e-4ee1-49cb-9673-fbbf03eef32c tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1444 microversion: 2.1 time: 0.150540 Sep 22 12:40:08.975725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 537/1058] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:08 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:10.809688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:10.820131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:10.820717 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:10.821148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:10.832544 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] Creating event network-changed:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:40:10.837452 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-03e82634-39ac-4389-b679-22c74878a9b2 req-9d221431-7a04-4a96-b59a-5b9e432d5040 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031421 Sep 22 12:40:10.838035 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 522/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:40:28.491837 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-992795592", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194840390", "security_groups": [{"name": "tempest-secgroup-smoke-358311579"}], "block_device_mapping_v2": [{"uuid": "a57e0618-b84c-4d4d-95c9-ddfb1c6c0f08", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a1ec96ed-6bf3-486f-b981-c8837f8cbc07"}]}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:28.503068 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=20 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:28.503739 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=48 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:28.615207 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.network.neutron [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] validate_networks() for [('a1ec96ed-6bf3-486f-b981-c8837f8cbc07', None, None, None, None, None)] {{(pid=120604) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 22 12:40:29.035569 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 22 12:40:29.035997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image limits 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 22 12:40:29.036506 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Flavor pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 22 12:40:29.036916 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Image pref 0:0:0 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 22 12:40:29.037330 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.virt.hardware [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120604) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 22 12:40:29.046270 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:29.046746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:29.047177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:29.047924 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:29.048409 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:29.048856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:29.065754 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 22 12:40:29.069602 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.quota [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Getting quotas for user f42af00458ac4046888a73397218f9f5 and project 5d44fc4fa85a4dfb82c31a602037a249. Resources: {'ram', 'cores', 'instances'} {{(pid=120604) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 22 12:40:29.125082 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Going to run 1 instances... {{(pid=120604) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 22 12:40:29.127706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a57e0618-b84c-4d4d-95c9-ddfb1c6c0f08',volume_size=None,volume_type=None)] {{(pid=120604) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 22 12:40:29.252130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a83cfb0a-7945-4814-ba4b-0715ee6ca582 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764602 Sep 22 12:40:29.252790 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 538/1060] 10.222.0.33 () {60 vars in 1147 bytes} [Thu Sep 22 12:40:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 22 12:40:29.262161 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:29.263012 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=44 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:29.268131 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5d3cc51d-8070-46d2-951b-f8c74031fb7b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:29.268989 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5d3cc51d-8070-46d2-951b-f8c74031fb7b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:29.324634 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5d3cc51d-8070-46d2-951b-f8c74031fb7b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:29.331457 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5d3cc51d-8070-46d2-951b-f8c74031fb7b tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1094 microversion: 2.1 time: 0.071162 Sep 22 12:40:29.332240 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 523/1061] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:29 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:30.354753 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:30.355489 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:30.362833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:30.363315 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:30.363746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:30.364473 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:30.364928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:30.365351 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:30.440666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:30.448832 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-32c49e3f-703e-41d7-9ee2-9ce827929b0a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1200 microversion: 2.1 time: 0.098796 Sep 22 12:40:30.449391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 539/1062] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:30 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1200 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:31.473284 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:31.473903 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:31.481525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:31.482016 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:31.482458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:31.483158 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:31.483615 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:31.484042 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:31.697582 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:31.706330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-ae1d8ba6-632c-421a-976f-46c6e9dc0e06 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.237830 Sep 22 12:40:31.706895 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 524/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:31 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:31.856913 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db99ee4-af57-405c-809c-cbb8b8928b8a", "tag": "5071ad34-e6b5-42b1-b2e1-23ffd18764a6"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:31.869502 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:31.870304 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:31.870733 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:31.883747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] Creating event network-changed:5071ad34-e6b5-42b1-b2e1-23ffd18764a6 for instance 6db99ee4-af57-405c-809c-cbb8b8928b8a on hv-cinder-85646 Sep 22 12:40:31.888843 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-11a2581b-f1f8-4d77-a820-bf41024ae9b9 req-37edd38a-bc50-45a1-8c21-4a6036a81508 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035662 Sep 22 12:40:31.889622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 540/1064] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:40:32.729313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:32.729937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:32.737281 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:32.737778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:32.738357 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:32.739109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:32.739567 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:32.740077 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:32.952456 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:32.960183 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-bd3cdbde-81d4-4960-8b73-55a3e0ae7656 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.234941 Sep 22 12:40:32.960835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 525/1065] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:32 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:33.990242 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:33.991206 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:33.997394 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:33.997871 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:33.998298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:33.998978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:33.999423 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:33.999839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:34.127729 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:34.135529 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-beda56e3-4618-4be0-8186-5109ec993c1d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.153822 Sep 22 12:40:34.136083 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 541/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:33 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:35.159423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:35.159966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:35.166512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:35.166987 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:35.167417 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:35.168100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:35.168579 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:35.169001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:35.300581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:35.308144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f35f87b2-05b2-4ed2-88d1-fb5dd96ef163 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.153296 Sep 22 12:40:35.308725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 526/1067] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:35 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:36.329893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:36.330497 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:36.336881 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:36.337354 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:36.337779 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:36.338460 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:36.338905 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:36.339326 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:36.465889 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:36.473959 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0bb4f63e-4770-4c96-ba2c-d51d21082e2a tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.147969 Sep 22 12:40:36.474518 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 542/1068] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:36 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:37.497322 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:37.497941 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:37.504543 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:37.505021 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:37.505451 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:37.506138 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:37.506586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:37.506999 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:37.636710 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:37.644893 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-7b3dbe1d-e342-4f07-a7dd-64ba44e68569 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.151391 Sep 22 12:40:37.645460 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 527/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:37 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:38.716733 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:38.717348 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:38.723824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:38.724332 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:38.724755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:38.725445 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:38.725898 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:38.726576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:38.862799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:38.870780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-e83d45c6-4276-42ed-98dc-97dc38a4d816 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.206650 Sep 22 12:40:38.871615 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 543/1070] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:38 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:40:39.893916 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:39.894528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:39.896883 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell0:SELECT=2 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:39.902034 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:39.902510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:39.902937 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:39.903616 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:39.904066 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:39.904510 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:40.034915 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:40.042587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-8d687f09-4d25-4f38-8580-33eae42ec898 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.152646 Sep 22 12:40:40.043149 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 528/1071] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:39 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:41.022865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db99ee4-af57-405c-809c-cbb8b8928b8a", "name": "network-vif-plugged", "status": "completed", "tag": "5071ad34-e6b5-42b1-b2e1-23ffd18764a6"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:41.028078 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:41.028774 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell0:SELECT=6 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:40:41.035781 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:41.036262 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:41.036730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:41.048247 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] Creating event network-vif-plugged:5071ad34-e6b5-42b1-b2e1-23ffd18764a6 for instance 6db99ee4-af57-405c-809c-cbb8b8928b8a on hv-cinder-85646 Sep 22 12:40:41.053431 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-8b577b81-afdd-43c1-b948-0943dcce52cd req-bff3dc13-7ac7-4eca-b2c9-c319be28966b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035023 Sep 22 12:40:41.054016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 544/1072] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:40:41.066833 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:41.068100 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:41.075945 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:41.076490 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:41.076936 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:41.077707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:41.078171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:41.078606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:41.495006 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:41.503555 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-3b0873d5-49cf-4608-8e0a-bb42e4dd6643 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.441041 Sep 22 12:40:41.504130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 529/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:41 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:42.526990 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:42.527687 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:42.534308 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:42.534800 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:42.535235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:42.535928 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:42.536400 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:42.536824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:42.666775 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:42.675145 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-91fa5abf-93a1-41d7-aeee-b87243af8e48 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1265 microversion: 2.1 time: 0.152351 Sep 22 12:40:42.675710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 545/1074] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:42 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:43.697728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:43.698335 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:43.704737 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:43.705212 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:43.705697 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:43.706379 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:43.706828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:43.707245 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:43.841401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:43.850061 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-88afa626-6e55-4e54-a911-3b448840aa29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1451 microversion: 2.1 time: 0.156224 Sep 22 12:40:43.850622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 530/1075] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:43 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:43.873727 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:40:43.874338 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:40:43.880723 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:43.884173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:43.884173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:43.884173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:43.884173 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:43.884706 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:44.008818 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:40:44.016397 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-4731d161-d0b3-4d84-883f-8ed8722ee0fe tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1451 microversion: 2.1 time: 0.146447 Sep 22 12:40:44.016956 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 546/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:40:43 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:40:45.568282 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db99ee4-af57-405c-809c-cbb8b8928b8a", "tag": "5071ad34-e6b5-42b1-b2e1-23ffd18764a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:40:45.578019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:40:45.578498 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:40:45.578924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:40:45.589906 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] Creating event network-changed:5071ad34-e6b5-42b1-b2e1-23ffd18764a6 for instance 6db99ee4-af57-405c-809c-cbb8b8928b8a on hv-cinder-85646 Sep 22 12:40:45.598253 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d2075493-7155-4702-ae9b-fd957bea0b2b req-2b120f5e-98ad-466f-96e4-947bd2dcc9e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033611 Sep 22 12:40:45.599085 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 531/1077] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:42:09.757251 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:09.758158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=42 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:09.762919 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:09.763450 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:09.771620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:09.772095 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:09.772564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:09.773253 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:09.773710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:09.774134 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:09.797008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.objects.instance [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lazy-loading 'flavor' on Instance uuid 3e0e560d-30a4-4a49-8068-9a2e57a77389 {{(pid=120604) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 22 12:42:09.865054 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-946ec91b-5999-49b6-be34-f3d40b7fbf0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "POST /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389/action" status: 202 len: 0 microversion: 2.1 time: 0.109392 Sep 22 12:42:09.865637 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 547/1078] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:42:09 2022] POST /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:42:09.872220 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=20 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:09.872994 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=44 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:09.874074 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 12:42:09.874286 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Thu Sep 22 12:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 (ip 10.222.0.33) !!! Sep 22 12:42:09.880870 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:09.881578 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:09.890657 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:09.891146 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:09.891771 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:09.892586 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:09.893020 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:09.893441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:10.030126 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:10.038728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a22eb74a-fc6a-4c5c-ab7e-9cf75055d2f2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.168518 Sep 22 12:42:10.039296 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 532/1079] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:09 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:11.062740 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:11.063437 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:11.069666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:11.070158 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:11.070589 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:11.071275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:11.071724 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:11.072144 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:11.199867 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:11.208099 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-0251e2c2-ac55-467a-a4c5-722e54bf21b2 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.150187 Sep 22 12:42:11.208700 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 548/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:11 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:12.231892 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:12.232495 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:12.239309 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:12.239785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:12.240213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:12.240929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:12.241373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:12.241791 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:12.371867 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:12.379572 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b5e83fb7-6b21-46ac-9d4b-380dc613f225 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.151623 Sep 22 12:42:12.380135 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 533/1081] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:12 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:13.402316 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:13.402923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:13.409375 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:13.409852 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:13.410283 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:13.410963 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:13.411414 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:13.411831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:13.539139 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:13.547399 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-dea8f1a4-e9cc-4db0-a87b-80e7ec9d82a4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.148938 Sep 22 12:42:13.547961 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 549/1082] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:13 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:14.571086 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:14.571719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:14.579098 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:14.579591 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:14.580039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:14.580798 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:14.581257 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:14.581688 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:14.716120 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:14.723924 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-b31f3d8e-8154-4baf-8689-576fec07c0c3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.156819 Sep 22 12:42:14.724778 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 534/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:14 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:15.441378 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:15.442025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:15.448714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.449219 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.450477 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.451185 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.451634 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.452281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.481116 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:42:15.499055 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db99ee4-af57-405c-809c-cbb8b8928b8a", "tag": "5071ad34-e6b5-42b1-b2e1-23ffd18764a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:15.508628 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.509363 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.509790 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.522203 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] Creating event network-changed:5071ad34-e6b5-42b1-b2e1-23ffd18764a6 for instance 6db99ee4-af57-405c-809c-cbb8b8928b8a on hv-cinder-85646 Sep 22 12:42:15.527976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-d5e2d5da-d001-43dc-8d08-6b0c75210e40 req-14ee64c8-dc23-4380-b577-b6ece8c0bbd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087676 Sep 22 12:42:15.529027 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 535/1084] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:42:15.574268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ec37b72e-6ed5-4afc-80a0-096aeb5be4aa tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 204 len: 0 microversion: 2.1 time: 0.137459 Sep 22 12:42:15.575556 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 550/1085] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:42:15 2022] DELETE /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:42:15.584409 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:15.585773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:15.597881 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.598776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.599815 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.600869 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.601530 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.602291 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.739756 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:15.747385 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:15.748013 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f032bc58-3e26-485b-9713-7a340ea85339 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1576 microversion: 2.1 time: 0.167805 Sep 22 12:42:15.748352 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:15.748810 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 536/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:15 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:15.754665 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.755217 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.755766 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.756576 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:15.757094 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:15.757578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:15.892621 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:15.900564 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ecf19a76-dbfd-4dbe-b692-f5c3d0aea045 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.157285 Sep 22 12:42:15.901127 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 551/1087] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:15 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:42:16.771639 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:16.772170 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:16.778558 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:16.779039 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:16.779470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:16.780157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:16.780632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:16.781047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:16.924819 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:16.925441 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:16.931747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:16.932226 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:16.932695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:16.933593 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:16.934040 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:16.934462 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:17.008201 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:17.015976 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-a6cb95ae-998d-4b29-84fc-0d4264da7088 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1576 microversion: 2.1 time: 0.248323 Sep 22 12:42:17.016646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 537/1088] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:16 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:17.136042 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:17.143755 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-da0d31cf-a627-49ab-a927-aea139679644 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.223488 Sep 22 12:42:17.144327 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 552/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:16 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:42:17.812568 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db99ee4-af57-405c-809c-cbb8b8928b8a", "name": "network-vif-deleted", "tag": "5071ad34-e6b5-42b1-b2e1-23ffd18764a6"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:17.821913 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:17.822328 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:17.822753 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:17.833773 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] Creating event network-vif-deleted:5071ad34-e6b5-42b1-b2e1-23ffd18764a6 for instance 6db99ee4-af57-405c-809c-cbb8b8928b8a on hv-cinder-85646 Sep 22 12:42:17.838448 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-4ab4d844-1c17-42b1-bc00-9dc72299e974 req-2d1686c4-3f0b-4120-80f2-949033c64907 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029726 Sep 22 12:42:17.839026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 538/1090] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:42:18.041452 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:18.041997 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:18.049892 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:18.050985 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:18.051749 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:18.052562 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:18.053203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:18.053759 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:18.124693 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:18.132989 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-cece5f4a-81c0-4b84-b59b-eb58583815b1 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 200 len: 1225 microversion: 2.1 time: 0.097191 Sep 22 12:42:18.133842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 553/1091] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:18 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:18.167561 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:18.168614 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:18.175226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:18.175700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:18.176136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:18.176871 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:18.177330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:18.177755 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:18.318425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:18.326801 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-c2d23c52-2e39-4a2d-b213-004d6b763859 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.163179 Sep 22 12:42:18.327745 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 539/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:18 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:19.157362 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:19.157921 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: 6db99ee4-af57-405c-809c-cbb8b8928b8a] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:19.164195 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:19.164701 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:19.165129 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:19.165804 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:19.166251 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:19.166666 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:19.180041 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] HTTP exception thrown: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Request method failure captured: Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a HTTP/1.1 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFaVNFGgTQv6QrQ3m94-i1TjWfb8ikdyrlbYKUHyVbU-ZuBnsjpfstew-GedK03WzIMBLrAc1NEEX4gMhbS--vm6YAcremJJnAYPkdEcKfbqqxC8C9sCVq8X_BQLL-NLl6wFONGVdk77OUjQkBG3jPBdyCoezHjLn_IzY___rPZGydE Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:42:19.181750 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d44fc4fa85a4dfb82c31a602037a249"}]}] Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: f42af00458ac4046888a73397218f9f5 Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. Sep 22 12:42:19.183534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '6db99ee4-af57-405c-809c-cbb8b8928b8a'} Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:42:19.184780 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. Sep 22 12:42:19.186942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:19.188607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Returning 404 to user: Instance 6db99ee4-af57-405c-809c-cbb8b8928b8a could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:42:19.188607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3471d71b-e3db-45f1-95ef-ab30f03f2cc0 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a" status: 404 len: 111 microversion: 2.1 time: 0.029750 Sep 22 12:42:19.188607 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 554/1093] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:19 2022] GET /compute/v2.1/servers/6db99ee4-af57-405c-809c-cbb8b8928b8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:42:19.350401 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:19.351019 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:19.357550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:19.358037 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:19.358509 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:19.359204 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:19.359662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:19.360088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:19.490356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:19.498177 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-85951b5c-7aba-4c27-a28a-1dce38a7b959 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.151926 Sep 22 12:42:19.498744 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 540/1094] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:19 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:20.522850 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:20.523468 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:20.530049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:20.530534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:20.530971 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:20.531734 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:20.532229 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:20.532686 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:20.669546 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:20.678942 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-491fcf59-f553-4325-94d9-c2f5d8c3b455 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.159980 Sep 22 12:42:20.679503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 555/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:20 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:21.702747 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:21.703811 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:21.710725 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:21.711223 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:21.711664 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:21.712393 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:21.712938 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:21.713373 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:21.891826 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:21.899632 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f81069bf-bb63-43ef-9024-278a38e6ce05 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.201051 Sep 22 12:42:21.900205 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 541/1096] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:21 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:22.341658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:22.342727 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:22.349243 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f899b259-9171-48fc-956e-1b7185432312", "tag": "862c2f78-8a44-46e8-a88c-6091a58bc3eb"}]} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:22.351268 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.351853 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.352552 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.353503 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.354187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.354824 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.361964 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.362459 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.362876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.374148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.compute.server_external_events [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] Creating event network-changed:862c2f78-8a44-46e8-a88c-6091a58bc3eb for instance f899b259-9171-48fc-956e-1b7185432312 on hv-cinder-85646 Sep 22 12:42:22.379620 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [req-e1545e1b-79e7-4931-8791-8e79bd680616 req-7d5e28cf-4ff4-48a2-928b-f807dbcf3d39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034073 Sep 22 12:42:22.380926 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 542/1097] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:42:22.390635 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Going to try to terminate instance {{(pid=120604) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:42:22.478856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-a5a307ce-4753-4959-bfee-ce7585946479 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 204 len: 0 microversion: 2.1 time: 0.141745 Sep 22 12:42:22.479625 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 556/1098] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:42:22 2022] DELETE /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:42:22.491842 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:22.494221 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:22.508440 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.509088 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.511942 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.512689 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.513422 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.513856 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.677820 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:22.688470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-4ea0eb58-c6bb-4ffa-8d6d-01aa82c1380e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1576 microversion: 2.1 time: 0.203042 Sep 22 12:42:22.689405 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 543/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:22 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:22.924787 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:22.925525 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:22.931355 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.931842 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.932281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:22.933011 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:22.933464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:22.933893 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:23.078746 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:23.086592 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-bf6c6b07-e018-402e-aaf2-3e3ff4f33b28 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.166690 Sep 22 12:42:23.087150 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 557/1100] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:22 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:23.713441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:23.714221 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:23.721148 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:23.721704 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:23.722376 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:23.724143 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:23.725053 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:23.725663 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:23.874268 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:23.882550 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-2706a4fc-c7f4-4ee2-a808-03bcf695dfd5 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1576 microversion: 2.1 time: 0.173488 Sep 22 12:42:23.883425 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 544/1101] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:23 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:24.109949 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:24.110692 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:24.117425 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.117902 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.118331 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.119019 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.119464 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.119879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.252120 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:24.255613 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:24.260708 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-53a2512a-080b-4bb9-a082-9bb54dd5535d tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1569 microversion: 2.1 time: 0.155085 Sep 22 12:42:24.261263 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 558/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:24 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:24.283320 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:24.283914 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:24.289800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.290276 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.290707 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.291383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.291828 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.292248 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.321886 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120603) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 22 12:42:24.392167 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [66192bac-877d-4531-9425-175c4d03b3f6] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 22 12:42:24.832978 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f899b259-9171-48fc-956e-1b7185432312", "name": "network-vif-deleted", "tag": "862c2f78-8a44-46e8-a88c-6091a58bc3eb"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:24.844743 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.845234 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.845812 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.859388 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] Creating event network-vif-deleted:862c2f78-8a44-46e8-a88c-6091a58bc3eb for instance f899b259-9171-48fc-956e-1b7185432312 on hv-cinder-85646 Sep 22 12:42:24.865679 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-20306bee-4957-49b5-b6b7-a38d06c67d37 req-ab623ad0-19a5-49d3-b3f0-2d2d3670bce9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037051 Sep 22 12:42:24.866275 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 559/1103] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:42:24.908911 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:24.909689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:24.916865 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.917377 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.917883 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.918580 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:24.919025 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:24.919443 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:24.985992 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f42af00458ac4046888a73397218f9f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44fc4fa85a4dfb82c31a602037a249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:24.994189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-16427383-c472-4c5b-9a5a-388edb9a489e tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 200 len: 1224 microversion: 2.1 time: 0.090830 Sep 22 12:42:24.994756 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 560/1104] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:24 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 22 12:42:25.385329 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "name": "network-vif-unplugged", "status": "completed", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:25.399597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO oslo.messaging._drivers.impl_rabbit [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [66192bac-877d-4531-9425-175c4d03b3f6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 59090. Sep 22 12:42:25.400674 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:25.401177 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:25.401622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:25.411064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-33c7e20b-01f8-4eb6-beb5-a575e9354c6f tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "POST /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389/action" status: 202 len: 0 microversion: 2.1 time: 1.131968 Sep 22 12:42:25.412104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 545/1105] 10.222.0.33 () {60 vars in 1278 bytes} [Thu Sep 22 12:42:24 2022] POST /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:42:25.413658 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.compute.server_external_events [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] Unable to find a host for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389. Dropping event network-vif-unplugged {{(pid=120604) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 22 12:42:25.414544 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-3d874230-d742-4976-86a3-24873ce74b3f req-ee67d0cc-5630-4ca5-897e-51f8b539a662 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033088 Sep 22 12:42:25.415560 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 561/1106] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 22 12:42:25.419934 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:25.420581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:25.427921 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:25.428617 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:25.429147 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:25.429975 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:25.430785 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:25.431300 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:25.584432 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:25.592470 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f86cec92-197a-4074-8437-1c35bd369f0e tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1517 microversion: 2.1 time: 0.176217 Sep 22 12:42:25.593041 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 546/1107] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:25 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:26.017622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:26.018230 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: f899b259-9171-48fc-956e-1b7185432312] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:26.024256 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.024769 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.025204 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.025890 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.026342 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.026765 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.040144 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] HTTP exception thrown: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Request method failure captured: Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 HTTP/1.1 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFaVNFGgTQv6QrQ3m94-i1TjWfb8ikdyrlbYKUHyVbU-ZuBnsjpfstew-GedK03WzIMBLrAc1NEEX4gMhbS--vm6YAcremJJnAYPkdEcKfbqqxC8C9sCVq8X_BQLL-NLl6wFONGVdk77OUjQkBG3jPBdyCoezHjLn_IzY___rPZGydE Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:42:26.041767 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d44fc4fa85a4dfb82c31a602037a249"}]}] Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: f42af00458ac4046888a73397218f9f5 Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. Sep 22 12:42:26.043533 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'f899b259-9171-48fc-956e-1b7185432312'} Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:42:26.044722 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. Sep 22 12:42:26.046347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.048611 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Returning 404 to user: Instance f899b259-9171-48fc-956e-1b7185432312 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:42:26.048611 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-71764b96-1c87-48d4-a317-76d17e74610c tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312" status: 404 len: 111 microversion: 2.1 time: 0.029374 Sep 22 12:42:26.048611 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 562/1108] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:26 2022] GET /compute/v2.1/servers/f899b259-9171-48fc-956e-1b7185432312 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:42:26.472714 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:26.473226 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:26.480570 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.481047 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.481476 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.482159 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.482606 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.483026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.496104 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.wsgi [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] HTTP exception thrown: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Request method failure captured: Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: request: DELETE /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 HTTP/1.1 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept: application/json Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Accept-Encoding: identity Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Connection: close Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Length: 0 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Content-Type: application/json Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Host: 10.222.0.33 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: Openstack-System-Scope: None Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: User-Agent: python-urllib3/1.26.12 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Auth-Token: gAAAAABjLFaVNFGgTQv6QrQ3m94-i1TjWfb8ikdyrlbYKUHyVbU-ZuBnsjpfstew-GedK03WzIMBLrAc1NEEX4gMhbS--vm6YAcremJJnAYPkdEcKfbqqxC8C9sCVq8X_BQLL-NLl6wFONGVdk77OUjQkBG3jPBdyCoezHjLn_IzY___rPZGydE Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Id: None Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Domain-Name: None Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Identity-Status: Confirmed Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Is-Admin-Project: True Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Id: default Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Domain-Name: Default Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Project-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Role: reader,member Sep 22 12:42:26.497800 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Roles: reader,member Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d44fc4fa85a4dfb82c31a602037a249"}]}] Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Id: default Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Domain-Name: Default Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Id: f42af00458ac4046888a73397218f9f5 Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: X-User-Name: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: method: > Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: exception: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.499458 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: action_args: {'id': 'cca03754-f373-43f1-b251-20165efd6733'} Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:42:26.501062 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.502378 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.504337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Returning 404 to user: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. {{(pid=120603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:42:26.504337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e35cf638-933f-446e-81dd-c196285c0f29 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 404 len: 111 microversion: 2.1 time: 0.031058 Sep 22 12:42:26.504337 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 547/1109] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:42:26 2022] DELETE /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:42:26.509534 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:26.510143 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] [instance: cca03754-f373-43f1-b251-20165efd6733] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:26.517155 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.517632 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.518060 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.518736 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.519182 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.519601 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.532742 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] HTTP exception thrown: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Request method failure captured: Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 HTTP/1.1 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFaVNFGgTQv6QrQ3m94-i1TjWfb8ikdyrlbYKUHyVbU-ZuBnsjpfstew-GedK03WzIMBLrAc1NEEX4gMhbS--vm6YAcremJJnAYPkdEcKfbqqxC8C9sCVq8X_BQLL-NLl6wFONGVdk77OUjQkBG3jPBdyCoezHjLn_IzY___rPZGydE Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:42:26.534240 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d44fc4fa85a4dfb82c31a602037a249"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d44fc4fa85a4dfb82c31a602037a249"}]}] Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: 5d44fc4fa85a4dfb82c31a602037a249 Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestVolumeBootPattern-2108571459 Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: f42af00458ac4046888a73397218f9f5 Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestVolumeBootPattern-2108571459-project Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.535918 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': 'cca03754-f373-43f1-b251-20165efd6733'} Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:42:26.536904 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. Sep 22 12:42:26.538467 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:42:26.539884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Returning 404 to user: Instance cca03754-f373-43f1-b251-20165efd6733 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:42:26.539884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-463de350-db57-4544-9df5-5f6ad4aa3f90 tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733" status: 404 len: 111 microversion: 2.1 time: 0.029879 Sep 22 12:42:26.539884 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 563/1110] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:26 2022] GET /compute/v2.1/servers/cca03754-f373-43f1-b251-20165efd6733 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:42:26.615525 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:26.616130 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:26.622787 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.623732 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.624213 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.626169 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:26.626917 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:26.627613 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:26.763030 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:26.771631 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-e237024e-3c9b-457a-b5c1-5a2a997c59a0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1517 microversion: 2.1 time: 0.160111 Sep 22 12:42:26.772229 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 548/1111] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:26 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:27.794894 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:27.806833 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:27.819620 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:27.820215 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:27.820717 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:27.821551 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:27.822013 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:27.822511 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:27.835423 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-581acc69-6992-4321-82c8-1517091eac9d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] Calling method '.version_select at 0x7f1079ae6ca0>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:27.870952 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-581acc69-6992-4321-82c8-1517091eac9d tempest-TestVolumeBootPattern-2108571459 tempest-TestVolumeBootPattern-2108571459-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194840390" status: 202 len: 0 microversion: 2.1 time: 0.039134 Sep 22 12:42:27.886512 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 549/1112] 10.222.0.33 () {58 vars in 1263 bytes} [Thu Sep 22 12:42:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194840390 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 22 12:42:27.992046 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:28.000038 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d68b68ae-26f7-4482-8ddb-73e4d1be7b3a tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1517 microversion: 2.1 time: 0.208955 Sep 22 12:42:28.001241 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 564/1113] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:27 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:29.023979 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:29.024662 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:29.031700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:29.032191 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:29.032674 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:29.033383 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:29.033841 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:29.034265 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:29.169966 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:29.178700 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-90fa5a55-4651-4c70-aab2-4fbf325e9036 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1517 microversion: 2.1 time: 0.159113 Sep 22 12:42:29.179366 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 550/1114] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:29 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:30.203138 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:30.204416 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:30.211137 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:30.211826 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:30.212531 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:30.213487 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:30.214149 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:30.214725 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:30.386049 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:30.395004 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-d3bbf079-6c99-43ee-bce6-b02b0ab7c747 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1519 microversion: 2.1 time: 0.195934 Sep 22 12:42:30.395668 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 565/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:30 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:31.418622 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:31.419233 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:31.426462 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:31.426946 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:31.427375 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:31.428109 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:31.428587 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:31.429007 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:31.433150 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:31.674776 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:31.683499 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-f05d79ac-1e75-4c5d-a59c-ea1a0e7596a6 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.268686 Sep 22 12:42:31.684064 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 551/1116] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:31 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:32.707689 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:32.708281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:32.714235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:32.714714 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:32.715141 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:32.715823 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:32.716269 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:32.716710 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:32.904799 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:32.912633 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-7e41924f-153d-49cc-87e6-f7292c0abfb0 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.209447 Sep 22 12:42:32.913189 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 566/1117] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:32 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:33.936584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:33.937372 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:33.944546 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:33.945399 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:33.945888 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:33.946646 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:33.947164 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:33.947804 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:34.158884 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:34.166983 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-5c32ae99-394e-4e26-afe1-2e3068790842 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.234309 Sep 22 12:42:34.167641 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 552/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:33 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:35.190504 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:35.191112 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:35.198762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:35.199255 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:35.199695 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:35.200421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:35.200880 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:35.201309 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:35.333235 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:35.342016 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-ab1e0cc4-5271-41b7-bb0a-9be1537fbb63 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.155588 Sep 22 12:42:35.342645 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 567/1119] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:35 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:36.364970 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:36.365584 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:36.372051 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:36.372564 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:36.373001 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:36.373686 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:36.374136 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:36.374556 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:36.502065 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:36.509724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-9e7d8c98-9bb1-4714-86a5-81e13ffbcaeb tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.148645 Sep 22 12:42:36.510283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 553/1120] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:36 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:37.533848 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:37.534471 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:37.540938 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:37.541427 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:37.541864 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:37.542558 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:37.543014 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:37.543439 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:37.672879 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:37.680856 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-f7c64881-757f-4702-a4cb-f597398811d3 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.151526 Sep 22 12:42:37.681421 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 568/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:37 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:38.703905 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:38.704481 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:38.710835 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:38.711313 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:38.711749 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:38.712450 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:38.712904 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:38.713319 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:38.842287 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:38.850693 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-95268595-9755-4326-83c9-104bd7d60202 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.150764 Sep 22 12:42:38.851249 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 554/1122] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:38 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:39.874810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:39.875429 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:39.878031 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:39.883047 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:39.883571 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:39.884008 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:39.884730 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:39.885244 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:39.885675 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:40.018802 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:40.028933 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-3336dd97-3c22-46ba-900b-1a60258f9fe5 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.157926 Sep 22 12:42:40.029512 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 569/1123] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:39 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:41.051719 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:41.052274 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:41.055330 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:42:41.060654 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:41.061144 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:41.061581 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:41.062283 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:41.062734 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:41.063157 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:41.197026 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:41.205197 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-418eddc6-b696-4239-8bf9-486f9bb66720 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.158087 Sep 22 12:42:41.205754 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 555/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:41 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:41.510747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "name": "network-vif-plugged", "status": "completed", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:42:41.521231 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:41.521711 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:41.522203 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:41.533307 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] Creating event network-vif-plugged:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:42:41.538187 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-47f17627-8b6a-48df-9c84-a956a4f0b06e req-93463e8e-c23f-42c5-b6aa-f647a99b1f09 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031145 Sep 22 12:42:41.538762 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 570/1125] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:42:42.229228 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:42.229847 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:42.237049 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:42.237531 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:42.237965 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:42.238653 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:42.239099 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:42.239520 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:42.368484 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:42.379929 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-83ac773c-d649-4b39-a86f-046cdc385e99 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1575 microversion: 2.1 time: 0.154589 Sep 22 12:42:42.380528 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 556/1126] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:42 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:42:43.403991 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:42:43.404712 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:42:43.411426 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:43.411908 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:43.412365 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:43.413061 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:42:43.413508 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:42:43.413930 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:42:43.547887 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:42:43.555599 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-5258fe6c-6175-4458-9f26-c792d9632cc9 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1562 microversion: 2.1 time: 0.156428 Sep 22 12:42:43.556153 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 571/1127] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:42:43 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:44:00.030868 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:00.031440 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:44:00.033188 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:44:00.037266 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_api:SELECT=5 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:44:00.038287 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG dbcounter [-] [120604] Writing DB stats nova_cell1:SELECT=58 {{(pid=120604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:44:00.039258 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 12:44:00.039422 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Thu Sep 22 12:44:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 22 12:44:00.040578 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 22 12:44:00.040968 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Thu Sep 22 12:44:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.33) !!! Sep 22 12:44:00.041195 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_api:SELECT=3 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:44:00.042218 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG dbcounter [-] [120603] Writing DB stats nova_cell1:SELECT=34 {{(pid=120603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 22 12:44:00.045222 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:00.045971 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:00.046597 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:00.047604 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:00.048250 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:00.048876 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:00.051476 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:00.052168 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:00.052622 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:00.065784 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] Creating event network-changed:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:44:00.070955 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-6c4972c2-ae44-43f0-b0f8-4a0a4441a0f9 req-40ea8df2-3fb6-40a4-9b92-5215d2fda2be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043839 Sep 22 12:44:00.071810 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 572/1128] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 22 12:44:00.080960 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Going to try to terminate instance {{(pid=120603) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 22 12:44:00.175855 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-cdd733c3-2e9c-4718-9912-0d2098acc280 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 204 len: 0 microversion: 2.1 time: 0.150820 Sep 22 12:44:00.176728 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 557/1129] 10.222.0.33 () {58 vars in 1239 bytes} [Thu Sep 22 12:44:00 2022] DELETE /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 22 12:44:00.185281 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:00.185972 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:44:00.193347 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:00.194157 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:00.194647 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:00.195298 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:00.195747 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:00.196391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:00.334033 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.policy [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120604) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:44:00.341923 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-406cc329-b163-4369-9485-9edad105f692 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.160910 Sep 22 12:44:00.342572 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 573/1130] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:44:00 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:44:01.364726 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:01.365436 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:44:01.372230 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:01.372738 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:01.373171 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:01.373859 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:01.374307 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:01.374724 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:01.515332 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:44:01.523538 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-36fa9e57-722e-456c-ac48-40b6629d4107 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1568 microversion: 2.1 time: 0.163087 Sep 22 12:44:01.524089 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 558/1131] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:44:01 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:44:02.366199 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e0e560d-30a4-4a49-8068-9a2e57a77389", "name": "network-vif-deleted", "tag": "a29921b4-d529-4d9c-9ca2-b26e9e8e791d"}]} {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 22 12:44:02.376623 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:02.377140 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:02.377598 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:02.389039 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.compute.server_external_events [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] Creating event network-vif-deleted:a29921b4-d529-4d9c-9ca2-b26e9e8e791d for instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 on hv-cinder-85646 Sep 22 12:44:02.394540 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [req-514e587d-e27d-4bd4-94dd-73f5f87554fc req-17f65bae-fa78-4b6e-948b-dae42b10b715 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Sep 22 12:44:02.395130 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 574/1132] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Sep 22 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 22 12:44:02.547224 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:02.548515 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.compute.api [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120603) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:44:02.554757 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:02.555235 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:02.555664 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:02.556381 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:02.556832 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:02.557252 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG oslo_concurrency.lockutils [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:02.623199 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.policy [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b3e6035de1e4fe3a651ece7d82842eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d530e1b20c47319f5e8949d808c1b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120603) authorize /opt/stack/nova/nova/policy.py:199}} Sep 22 12:44:02.631356 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-1dc448b5-56eb-4d09-a0e4-3b3b01663861 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 200 len: 1220 microversion: 2.1 time: 0.088322 Sep 22 12:44:02.631922 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 559/1133] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:44:02 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 22 12:44:03.654408 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '>' {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:03.655113 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.compute.api [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] [instance: 3e0e560d-30a4-4a49-8068-9a2e57a77389] Fetching instance by UUID {{(pid=120604) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 22 12:44:03.661302 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:03.661785 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:03.662220 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:03.662908 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Acquiring lock "42be6b44-0984-4460-8191-0bf6d60d534a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 22 12:44:03.663391 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 22 12:44:03.663839 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG oslo_concurrency.lockutils [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Lock "42be6b44-0984-4460-8191-0bf6d60d534a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 22 12:44:03.677285 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.wsgi [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] HTTP exception thrown: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Request method failure captured: Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: request: GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 HTTP/1.1 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept: application/json Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Accept-Encoding: identity Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Connection: close Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Length: 0 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Content-Type: application/json Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Host: 10.222.0.33 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: Openstack-System-Scope: None Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: User-Agent: python-urllib3/1.26.12 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Auth-Token: gAAAAABjLFeCFEnRVs5s-UXaToKOT3QHiLvh3bIS4CFklmpubhGA6U43o53JSSki7jrLQRlkGHE9jNPiWULihTvrkhPTm-FsyVvvgVQL-BqFfx0O37WDehGkulCmb6UNkb16VFCgUV4cpC4LHqhCMKoeLLOwy8q0Mw-IC8RUAq-HMW4s6advCoE Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Id: None Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Domain-Name: None Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Identity-Status: Confirmed Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Is-Admin-Project: True Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Id: default Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Domain-Name: Default Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Id: f4d530e1b20c47319f5e8949d808c1b3 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Project-Name: tempest-TestShelveInstance-453634941 Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Role: reader,member Sep 22 12:44:03.678861 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Roles: reader,member Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d530e1b20c47319f5e8949d808c1b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d530e1b20c47319f5e8949d808c1b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d530e1b20c47319f5e8949d808c1b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d530e1b20c47319f5e8949d808c1b3"}]}] Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant: tempest-TestShelveInstance-453634941 Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Id: f4d530e1b20c47319f5e8949d808c1b3 Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-Tenant-Name: tempest-TestShelveInstance-453634941 Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User: tempest-TestShelveInstance-453634941-project Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Id: default Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Domain-Name: Default Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Id: 7b3e6035de1e4fe3a651ece7d82842eb Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: X-User-Name: tempest-TestShelveInstance-453634941-project Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: method: > Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: exception: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. Sep 22 12:44:03.680797 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: action_args: {'id': '3e0e560d-30a4-4a49-8068-9a2e57a77389'} Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: {{(pid=120604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 22 12:44:03.682028 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. Sep 22 12:44:03.683831 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: ERROR nova.api.openstack.wsgi Sep 22 12:44:03.685590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: DEBUG nova.api.openstack.wsgi [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Returning 404 to user: Instance 3e0e560d-30a4-4a49-8068-9a2e57a77389 could not be found. {{(pid=120604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 22 12:44:03.685590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: INFO nova.api.openstack.requestlog [None req-8c61963b-aea1-4d96-853a-51fe17f6eaf7 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389" status: 404 len: 111 microversion: 2.1 time: 0.030624 Sep 22 12:44:03.685590 dv-cinder-856463-4-iscsi devstack@n-api.service[120604]: [pid: 120604|app: 0|req: 575/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Thu Sep 22 12:44:03 2022] GET /compute/v2.1/servers/3e0e560d-30a4-4a49-8068-9a2e57a77389 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 22 12:44:03.851441 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: DEBUG nova.api.openstack.wsgi [None req-fc99aa2b-c1f5-4e9a-b5ac-a975082c64f4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] Calling method '.version_select at 0x7f1079a53280>' {{(pid=120603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 22 12:44:03.880106 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: INFO nova.api.openstack.requestlog [None req-fc99aa2b-c1f5-4e9a-b5ac-a975082c64f4 tempest-TestShelveInstance-453634941 tempest-TestShelveInstance-453634941-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1847061826" status: 202 len: 0 microversion: 2.1 time: 0.032726 Sep 22 12:44:03.880910 dv-cinder-856463-4-iscsi devstack@n-api.service[120603]: [pid: 120603|app: 0|req: 560/1135] 10.222.0.33 () {58 vars in 1254 bytes} [Thu Sep 22 12:44:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1847061826 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)